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(54) IMAGE PROCESSOR AND IMAGE PROCESSING METHOD AND RECORDED MEDIUM 

(57) The present invention comprises an input part 
for inputting image data, a receiving part for receiving 
production information relating to production transmit- 
ted from another apparatus, a recording part for record- 
ing tlie production information received by the receiving 
part and image data input by the input part, a detection 
part for detecting a recording position on a recording 
medium at an editing point of image data recorded by 
the recording part, and a transmission part for transmit- 
ting infonnation of the recording position detected by the 
detection part, whereby identification information for 
identifying image data and voice data is recorded in a 
recording medium or'a recording device, this relieving 
a burden on a photographer and an editor and facilitat- 
ing extraction of image data and voice data. 



r138 



137. 




COMMUNMCATION 



WCRO- 
COMFUTER 



r141 



CM 
CO 



FIG-17 



O. 
lU 



BNSDOCID: <EP 11B7472A1_U> 



Printed by Jouve, 75{X)1 PARIS (FR) 



EP1 187 472 A1 



Description 
Technical Field 

[0001] The present invention relates to an image 
processing apparatus for recording image data and dis- 
crimination information for discriminating image data in 
a recording medium, an Image processing method and 
an image processing system; a data transmission ap- 
paratus, a data receiving apparatus and a data trans- 
mitting and receiving system; and a recording medium, 
and more particularly to an image processing apparatus 
for recording production Information at the time of pro- 
ducing image data and editing information at the time of 
editing together with image data, and an image process- 
ing method; an image processing apparatus for trans- 
mitting production infomnatlon at the time of producing 
image data to another apparatus to record the fonner 
together with image data, and an image processing 
method; an image processing system for receiving im- 
age data from another apparatus and production infor- 
mation to transmit position information at the editing 
point to another apparatus, a data receiving apparatus 
for receiving production information from another appa- 
ratus, and a data transmission apparatus for transmit- 
ting discrimination information to another apparatus; a 
data transmitting and receiving system constituted by 
the data transmission apparatus and the data receiving 
apparatus, and a recording medium having a program 
for the process of recording production information at 
the time of producing image data and editing infomnatlon 
at the time of editing together with image data. 

Background Art 

[0002] There has been popularized the art for record- 
ing Information corresponding to an editing point as ad- 
ditional information together with image data when an 
image pick-up device records image data in a receding 
medium. An editor is able to retrieve an editing point as 
desired by referring to the additional information. 
[0003] In the past, the additional Infomriation has been 
input as a photographer operates an input device pro- 
vided on the image pick-up device before production. In 
this case, the image pick-up device records the input 
additional Infomiation and Image data in the recording 
medium. 

[0004] Further, one method for editing image infonna- 
tion recorded in a recording medium such as a video 
tape is a off-line edition. The off-line edition is a method 
for copying, in a production site, image information re- 
corded in an original tape to a separate recording tape 
(an editing tape) once, preparing editing data at the ed- 
iting point on the editing tape, and preparing a master 
tape on the basis of the editing data. In the off-line edi- 
tion, it is not feared that original image information re- 
corded In an original tape, for being recording in an ed- 
iting tape, is erased or rev^ritten by mistake, and a mas- 
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ter tape as desired can be prepared. 
[0005] However, in the off-line edition, editing work is 
carried out using an editing tape having an original tape 
copied, thus posing a problem that when information re- 
5 corded on the original tape is coped on the editing tape, 
it takes time and Involves trouble. So, one method for 
solving such a problem as noted above is a method for 
copying information on the original tape on a disk-like 
recording medium capable of recording and capable of 
random accessing such as a hard disk once, and pre- 
paring editing data using copied information on the disk- 
like recording medium. According to this method, since 
the time for getting access to the editing point Is short- 
ened, the time required for the editing work can be short- 
ened. However, in the conventional editing device, when 
CG or the like is combined with image data, an editor 
need to input it, and data base is so enormous that work 
which is troublesome for an editor results. Further, for 
example, in a case where other information such as a 
map is combined with an image for display it, it has been 
necessary to retrieve and extract other information such 
as a map to be combined with Image data from the data 
base. 

[0006] On the other hand, with the popularization of 
communication making use of a network line (circuit) 
such as a so-called Internet in which a plurality of net- 
works to thereby constitute an imaginary network, dis- 
tribution of various content data such as image data, 
voice data and so on becomes enabled using the net- 
work line such as an Internet. With this, a broadcasting 
station for producing and broadcasting programs be- 
comes necessary to administrate individual detailed in- 
formation even with respect to fragmentary image data 
and voice data. More concretely, it is necessary to dis- 
tribute various additional information such as infomna- 
tlon for discriminating a broadcasting material produced 
as a program in a broadcasting station or the like, infor- 
mation relating to copyright of contents, and so on to- 
gether with contents. 

Disclosure of the Invention 

[0007] It is an object of the present invention to pro- 
vide an Image processing apparatus In which a burden 
on a user using the image processing apparatus to input 
discrimination information is relieved, an Image 
processing method and an image processing system; a 
data transmission apparatus for transmitting'discrimina- 
tion infomnatlon, a data receiving apparatus for receiving 
discrimination information and a data transmitting and 
receiving system for transmitting and receiving discrim- 
ination information; and a recording medium having a 
program of process recorded, the process recording dis- 
crimination information of image data together with im- 
age data. 

[0008] The present Invention proposed in order to 
achieve the object as described above comprises an in- 
put part for inputting image data, a receiving part for re- 
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ceiving production Information relating to production 
transmitted fomn another apparatus, a recording part for 
recording production information received by the receiv- 
ing part and image data input by the input part in a re- 
cording medium, a detection part for detecting a record- 
ing position of an editing point of image data recorded 
by the recording part on the recording medium: and a 
transmission part for.transmitting information of the re- 
cording position detected by the detection part to anoth- 
er apparatus. . 

[0009] Further, the present invention includes an input 
step of inputting image data, a receiving step of receiv- 
ing production infomnation relating to production trans- 
mitted form another apparatus, a recording step of re- 
cording production infomnation received by the receiving 
step and image data input by the input step in a record- 
ing medium, a detection step of detecting a recording 
position of an editing point of Image data recorded by 
the recording step on the recording medium, and a 
transmission step of transmitting Information of the re- 
cording position detected by the detection step. 
[0010] Further, the present invention provides a re- 
cording medium having recorded a program which con- 
trols an Image processing apparatus for recording Im- 
age data in a recording medium, the program causing 
a computer to execute a process including an Input con- 
trol step of controlling an input of Image data, an Incor- 
poration control step of controlling an incorporation of 
production Infomnation relating to production transmit- 
ted from another apparatus, a record control step of con- 
trolling recording of production information whose Incor- 
poration is controlled In the Incorporation control step 
and image data input In the input control step to the re- 
cording medium, a detection control step of controlling 
detection of a recording position of an editing point of 
image data record in the record control step on the re- 
cording medium, and a transmission control step of con- 
trolling transmission of Infomrjation of the recording po- 
sition detected in the detection control step to another 
apparatus. 

[001 1 ] . Furthermore; the present Invention comprises 
an input part for Inputting production infomnation relating 
to production by another apparatus, a storage part for 
storing production Infomnation input by the input part 
corresponded to another apparatus, a transmission part 
for transmitting production infomnation stored in the stor- 
age part to another apparatus, a receiving part for re- 
ceiving position information of an editing point of Image 
data recorded In a recording medium on the recording 
medium, and an adding part for adding position Infor- 
mation received by the receiving part to production in- 
formation stored in the storage part. 
[001 2] Furthermore, the present Invention includes an 
Input step of Inputting production information relating to 
production by another apparatus, a storage step of stor- 
ing production information input by the Input step corre- 
sponded to another apparatus, a transmission step of 
transmitting production Information stored in the storage 



step to another apparatus, a receiving step of receiving 
position Information of an editing point of Image data re- 
corded in a recording medium on the recording medium, 
and an adding step of adding position information re- 
5 ceived by the receiving step to production information 
stored in the storage step. 

[0013] Furthemnore present invention provides a re- 
cording medium having recorded a program which con- 
trols an image processing apparatus for administrating 
10 image data recorded in a recording medium by another 
image processing apparatus, the program causing a 
computer to execute a process including an Input control 
step of controlling an input of production information re- 
lating to production by another apparatus, a storage 
^5 control step of controlling storing production information 
Input in the input control step corresponded to another 
apparatus, a transmission control step of controlling 
transmitting production information stored In the storage 
control step to another apparatus, an incorporation con- 
trol step of controlling incorporating position information 
at an editing point of Image data recorded In a recording 
medium transmitted from another apparatus on the re- 
cording medium, and an addition control step of control- 
ling addition of position information incorporated in the 
Incorporation control step to production Information 
stored in the storage control step. 
[0014] Furthermore, the present invention provides 
an image processing system comprising a first image 
processing apparatus for recording image data in a re- 
cording medium, and a second Image processing appa- 
ratus for administrating image data recorded In the re- 
cording medium by the first image processing appara- 
tus, the first Image processing apparatus comprising a 
first input part for inputting image data, a first receiving 
part for receiving production infomnation relating to pro- 
duction transmitted from the second image processing 
apparatus, a recording part for recording production in- 
formation received by the first receiving part and image 
data input by the first input part, a detection part for de- 
tecting a recording position at an editing point of image 
data recorded by the recording part on the recording me- 
dium, and a first transmission part for transmitting infor- 
mation of a recording position detected by the detection 
part to the second image processing apparatus, the sec- 
ond image processing apparatus comprising a second 
Input part for inputting production information relating to 
production by the first image processing apparatus, a 
storage part for storing production information input by 
the second input part corresponded to the first Image 
processing .apparatus, a second transmission part for 
transmitting production infomnation stored In the storage 
part to the first Image processing apparatus, a second 
receiving part for receiving position Information at an ed- 
iting point of image data recorded in a recording medium 
transmitted from the first image processing apparatus 
on the recording medium, and an addition part for add- 
ing position information received in the second receiving 
part to production Information stored in the storage part. 
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[0015] Furthermore, in the present invention, a first 
image processing method of the first image processing 
apparatus includes a first input step of inputting image 
data, a first receiving step of receiving production infor- 
mation relating to production transmitted from the sec- 
ond image processing apparatus, a recording step of re- 
cording production information received in the first re- 
ceiving step and image data input in the first input step, 
a detection step of detecting a recording position at an 
editing point of image data recorded in the recording 
step on the recording medium, and a first transmission 
step of transmitting infomriation of a recording position 
detected in the detection step to the second image 
processing apparatus, and an image processing meth- 
od of the second image processing apparatus includes 
a second input step of inputting production infomiatlon 
relating to production by the first image processing ap- 
paratus, a storage step of storing production information 
input in the second Input step corresponded to the first 
image processing apparatus, a second transmission 
step of transmitting production information stored in the 
storage step to the first image processing apparatus, a 
second receiving step of receiving position information 
at an editing point of image data recorded in a recording 
medium transmitted from the first image processing ap- 
paratus on the recording medium, and an addition step 
for adding position infomriation received in the second 
receiving step to production information stored in the 
storage step. 

[001 6] Furthermore, the present invention provides a 
recording medium having recorded programs which 
control an image processing system comprising a first 
image processing apparatus for recording image data 
In a recording medium, and a second image processing 
apparatus for administrating image data recorded in the 
recording medium by the first image processing appa- 
ratus, the program for controlling the first image 
processing apparatus including a first input control step 
of controlling an input of image data, a first incorporation 
control step of controlling Incorporation of production in- 
formation relating to production transmitted from the 
second image processing apparatus, a record control 
step of controlling recording. of production infomiation 
incorporated in the first incorporation control step and 
image data input in the first input control step In the re- 
cording medium, a detection control step of controlling 
detection of a recording position of an editing point of 
Image data recorded in the record control step on the 
recording medium, and a first transmission control step 
of controlling transmissipn of information of the record- 
ing position detected in the detection control step, the 
program for controlling the second image processing 
apparatus having a program for causing a computer to 
execute a process recorded, the process including a 
second Input control step of controlling an Input of pro- 
duction Information relating to production by the first im- 
age processing apparatus, a storage control step of con- 
trolling storing production information input in the sec- 



ond input control step con^esponded to the first image 
processing apparatus, a second transmission control 
step of controlling transmission of production Informa- 
tion stored in the storage control step to the first image 
5 processing apparatus, a second incorporation control 
step of controlling incorporation of position information 
at an editing point of image data recorded in the record- 
ing medium transmitted from the first image processing 
apparatus on the recording medium, and an addition 
10 control step of controlling adding position information in- 
corporated in the second incorporation step to produc- 
tion information stored in the storage control step. 
[0017] Furthermore, the present Invention comprises 
an input part for producing and inputting at least one out 

15 of metadata representative of a gathering location place 
showing a place name of a gathering location relating 
to news program gathering (Gathering_Locatlon_ 
Place), a photographer showing a name of a photogra- 
pher (Photographer), journalist information showing in- 

20 formation relating to a journalist In charge of gathering 
(Joumalist Information), a director showing a director of 
a news program (Director), contents having other infor- 
mation relating to production contents described (Con- 
tents), gathering start date time showing production 

25 start date time (Gathering_Start_DateTime), gathering 
end date time showing production end time (Gathering_ 
End_DateTlme), a producer showing a producer of a 
news program (Producer), a news program item regis- 
tered in an NCS (Newsroom Computer System) and 

30 NCS ID as an identifier set for every program (NCS ID), 
and a transmission part for transmitting metadata to a 
mover at gathering destination wirelessly. 
[0018] Furthermore, the present invention comprises 
a receiving part for receiving at least one out of metadata 

55 representative of a gathering location. place showing a 
place name of a gathering location relating to news pro- 
gram gathering (Gathering_Location_Place), a photog- 
rapher showing a name of a photographer (Photogra- 
pher), joumalist infonnation showing infomiation relat- 
ing to a journalist in charge of gathering (Joumalist In- 
formation), a director showing a director of a news pro- 
gram (Director), contents having other infonnation relat- 
ing to production contents described (Contents), gath- 
ering start date time showing production start date time 
(Gathering_Start_DateTlme). gathering end date time 
showing production end time (Gathering_End_Date- 
Trme), a producer showing a producer of a news pro- 
gram (Producer), a news program item registered in an 
NCS (Newsroom Computer System) and NCS ID as an 

so identifier set for every program (NCS ID), and a storage 
part for storing metadata received. 
[0019] Furthermore, the present invention comprises 
an input part for producing and inputting at least one out 
of metadata representative of a gathering location place 

55 showing a place name of a gathering location relating 
to news program gathering (Gathering_Locatioh_ 
Place), a photographer showing a name of a photogra- 
pher (Photographer), journalist infonnation showing in- 
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formation relating to a journalist in charge of gathering 
(Journalist Information): a director showing a director of 
a news program (Director), contents having other infor- 
mation relating to production contents described (Con- 
tents), gathering start date time showing production 
start date time (Gathering_Start_DateTime), gathering 
end date time showing production end time (Gathering. 
End_DateTime), a producer showing a producer of a 
news program (Producer), a news program Item regis- 
tered in an NCS (Newsroom Computer System) and 
NCS ID as an identifier set for every program (NCS ID), 
a data transmission device having a transmission part 
for transmitting metadata wirelessly, a receiving part for 
receiving metadata relating to news program gathering 
transmitted from the data transmission device, a storage 
part for storing metadata received, and a data receiving 
device. 

[0020] Furthemiore, the present invention comprises 
a metadata storage part for storing metadata transmit- 
ted from outside, a metadata producing part for produc- 
ing at least one out of metadata representative of a gath- 
ering location latitude representative of latitude of a pho- 
tographing place (Gathering_Location_Latitude), a 
gathering location longitude representative of a longi- 
tude of a photographing place (Gathering_Location_ 
Longitude), a gathering location altitude representative 
of altitude of a photographing place (Gathering. 
Location_Altitude), a gathering location time represent- 
ative of time when photographing takes place 
(Gathering_Location_Tlme), machine ID for identifying 
a photographing device, camera setup information 
showing setting of a photographing device (Camera 
Setup Infomiation), a reel number for identifying a re- 
cording medium (Reel Number), duration showing time 
required for photographing (Duration), start of material 
representative of start time of each scene (Start Of Ma- 
terial), a title representative of gathering title (Title), a 
good shot mark showing a mark point manually input 
when photographing take place (Good Shot Mari<), 
record start mari< (REC Start Mark), audio channel in- 
formation showing a microphone channel (Audio Chan- 
nel Information), an audio type showing if a voice record 
is mono, stereo or bilingual (Audio Type), UMID audio 
whkJh is ID decided solely for identifying material (UMID 
(Audio)), UMID video (UMID (video)), copyright repre- 
sentative of copyright of mat^erial data (Copyright); and 
a recording part for recording Image data in a recording 
medium, wherein metadata produced is recorded in the 
recording medium together with image data. 
[0021] Furthermore, the present invention comprises 
a metadata storage step of storing metadata transmitted 
from outside, a metadata producing step of producing 
at least one out of metadata representative of a gather- 
ing location latitude representative of latitude of a pho- 
tographing place (Gathering_Location_Latitude), a 
gathering location longitude representative of a longi- 
tude of a photographing place (Gathering_Location_ 
Longitude), a gathering location altitude representative 



of altitude of a photographing place (Gathering,. 
Location.Altitude), a gathering location time represent- 
ative of time when photographing takes place 
(Gathering_Location_Time), machine ID for identifying 

5 a photographing device, camera setup information 
showing setting of a photographing device (Camera 
Setup Information), a reel number for identifying a re- 
cording medium (Reel Number), duration showing time 
required for photographing (Duration), start of material 

10 representative of start time of each scene (Start Of Ma- 
terial), a title representative of gathering title (Title), a 
good shot mark showing a mark point manually input 
when photographing take place (Good Shot Mark), 
record start mark (REC Start Mark), audio channel in- 

15 formation showing a microphone channel (Audio Chan- 
nel Information), an audio type showing if a voice record 
is mono, stereo or bilingual (Audio Type). UMID audio 
which is ID decided solely for identifying material (UMID 
(Audio)), UMID video (UMID (video)), copyright repre- 
20 sentative of copyright of material data (Copyright); and 
a recording step of recording metadata stored in the 
metadata storage step, metadata produced in the meta- 
data producing step, and image data in a recording me- 
dium. 

25 [0022] Furthermore, the present invention comprises 
an Input step of inputting image data, a gathering loca- 
tion latitude representative of a latitude of a photograph- 
ing place in connection with position information when 
image data is photographed (Gathering_Location_Lat- 

30 itude), a gathering location longitude representative of 
longitude of a photographing place (Gathering. 
Location_Longitude), and metadata representative of a 
gathering location altitude representative of altitude of 
a photographing place (Gathering_Location_Altltude); a 

35 retrieval step of retrieving and extracting a map corre- 
sponding to position infomnation out of maps recorded 
in a recording device; and a combining step of combin- 
ing and displaying the map corresponding to position in- 
formation in a predetermined position of image data. 

40 [0023] Furthermore, the present invention comprises 
an input step of Inputting image data, and metadata rep- 
resentative of gathering location time representative of 
time when photographing takes place in connection with 
time information when image data is photographed 

45 (Gathering_Location_Time), and a combining step of 
combining and displaying time information correspond- 
ing to image data in a predetermined position of Image 
data. 

[0024] Furthermore, the present invention comprises 
50 an input step of inputting image data, and metadata rep- 
resentative of a title showing a gathering title in connec- 
tion with photographing of image data (Title) and a script 
in connection with a news manuscript (Script); and a 
combining step of combining and displaying metadata 
55 in a predetermined position of image data, 

[0025] Furthermore, the present Invention comprises 
a display part for displaying a combined image of image 
datia and infomnatlon relating to image data; an input part 
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for Inputting metadata representative of a gathering lo- 
cation latitude representative of latitude of a photo- 
graphing place in connection with image data and posi- 
tion information when image data is photographed 
(Gathering_Locatlon_Latitude), a gathering location 
longitude representative of longitude (Gathering.. 
Location_Longitude), a gathering location altitude rep- 
resentative of altitude of a photographing place 
(Gathering_Location_Altitude), a title showing a gather- 
ing title in connection with photographing of image data 
(Title), and metadata representative of a script in con- 
nection with a news manuscript (Script); a recording part 
for recording metadata showing position infonnation; 
and a combining part for combining and displaying in- 
fonnation based on metadata corresponding to image 
data in a predetermined position of image data. 
[0026] Other objects of the present invention, and 
concrete advantages obtained by the present invention 
will become further apparent from the ensuing descrip- 
tion with reference to the drawings. 

Brief Description of the Drawings 

[0027] FIG. 1 is an explanatory view for explaining a 
series of steps of making a gathering plan to carry out 
gathering, editing material obtained by gathering to 
broadcast it, and archiving a program broadcast. 
[0028] FIG. 2 is a view showing a concrete example 
of metadata produced in the planning step. 
[0029] FIG. 3 is a view showing a concrete example 
of metadata transmitted from a base station to an image 
pick-up device in the course of shifting from the planning 
step to the gathering step. 

[0030] FIG. 4A is a view showing a concrete example 
of metadata input in the image pick-up device at the time 
of photographing, and FIG. 4B is a view showing a con- 
crete example of metadata input when stored In a ma- 
terial accumulation device. 

[0031 ] FIG. 5A is a view showing a concrete example 
of metadata input in the image pick-up device at the time 
of photographing, and FIG. 5B is a view showing a con- 
crete example of metadata input when a temporary ed- 
iting is carried out in NCS. 

[0032] FIG. 6A is a view showing a concrete example 
of metadata input in the image pick-up device at the time 
of photographing, and FIG. 6^ is a view showing a con- 
crete example of metadata input and or modified In the 

real editing step. 

[0033] FIG. 7 is a view showing a concrete example 
of metadata used when a CG combined image plane Is 
prepared automatically. 

[0034] FIG. B is a block diagram showing a concrete 
constitution of an image processing system shown as 
one constitutional example of the present invention. 
[0035] FIG. 9 Is a view showing metadata used in an 
image processing system shown as one constitutional 
example of the present invention. 
[0036] FIG. 1 0 is a view showing metadata used in an 
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image processing system shown as one constitutional 
example of the present invention. 
[0037] FIG. 11 is a view showing metadata used in an 
image processing system shown as one constitutional 

5 example of the present invention. 

[0038] FIG. 12A is a schematic view for explaining a 
SDI format used as a data transmission fonmat of an im- 
age processing system shown as one constitutional ex- 
ample of the present invention, and FIG. 1 2B is a sche- 

10 matic view for explaining one line of the SDI fonnat. 
[0039] FIG. ISA is a schematic view for explaining a 
data construction of a SDI fomriat used as a data trans- 
mission fonmat of an image processing system shown 
as one constitutional example of the present invention, 

15 and FIG. 1 38 is a schematic view for explaining one line 
of the SDI fonnat. 

[0040] FIG. 14 is a schematic view for explaining a 
SDTI-CP fonnat used as a data transmission fomnat of 
an image processing system shown as one conslitution- 
al example of the present invention. 
[0041] FIG. 15 is a schematic view for explaining a 
KLV format of an image processing system shown as 
one constitutional example of the present invention. 

25 Best Mode for Carrying out the Invention 

[0042] FIG. 16 is a schematic view for explaining a 
format of UMID used as a data transmission format of 
an image processing system shown as one constitution- 

30 al example of the present invention. 

[0043] FIG. 1 7 is a block diagram showing a concrete 
constitution of an Image pick-up device, a base station, 
and a data administrative device of an image processing 
system shown as one constitutional example of the 

55 present invention. 

[0044] FIG. 1 8 is a block diagram showing a concrete 
constitution of a recording and reproducing device of an 
image processing system shown as one constitutional 
example of the present Invention. 

40 [0045] FIG. 19 is a block diagram showing a concrete 
constitution of a material accumulation device of an im- 
age processing system shown as one constitutional ex- 
ample of the present Invention. 

[0046] FIG. 20 is a block diagram showing a concrete 
45 constitution of an editing device of an image processing 
system shown as one constitutional example of the 
present invention. 

[0047] FIG. 21 is a flow chart showing a process when 
an image pick-up device receives metadata transmitted 
so from a data administrative device In an image process- 
ing system shown as one constitutional example of the 
present Invention. 

[0048] FIG. 22 is a view for explaining metadata used 
In an image processing system shown as one constitu- 
55 tional example of the present Invention. 

[0049] FIG. 23 is a flow chart for explaining a process 
when a data administrative device receives metadata in 
an Image processing system shown as one constltution- 
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al example of the present invention. 
[0050] FIG. 24 is a flow chart for explaining a process 
when a data administrative device in an image process- 
ing system shown as one constitutional example of the 
present invention updates metadata. 
[0051] FIG. 25 Is a schematic view for explaining a 
graphical user interface for preparing CG combined im- 
age plane in an image processing system shown as one 
constitutional example of the present invention. 
[0052] FIG. 26 is a flow chart showing a process when 
an editing device retrieves a map on the basis of position 
information to combine It with image data in an image 
processing system shown as one constitutional exam- 
ple of the present invention. 

[0053] FIG. 27 is a flow chart showing a process when 
an editing device display time information and a title in 
an image processing system shown as one constitution- 
al example of the present invention. 

Best Mode for Carrying out the Invention 

[0054] In the following, an image processing appara- 
tus and an image processing method, an image 
processing system, a data transmission apparatus and 
a data receiving. apparatus, a data transmitting and re- 
ceiving system, and a recording medium according to 
the present invention will be described In detail with ref- 
erence to the drawings. 

[0055] The image processing system according to the 
present invention is, in an Image processing apparatus 
for recording image data in a recording medium, an im- 
age processing apparatus comprising an input part for 
inputting image data, a recording part for recording pro- 
duction information in connection with photographing 
transmitted from other apparatuses and image data In 
a recording medium, a detection part for detecting a re- 
cording position on the recording at an editing point of 
image data recorded by the recording part, and a trans- 
mission part for transmitting information of the recording 
position detected by the detection part. This can be ap- 
plied, for example, to an image processing system in 
which In a broadcasting station, an image producing 
company and the like, an image and voice or the like 
(hereinafter referred to as material) are edited and proc- 
essed to produce an image for broadcasting, and the 
Image Is archived. Partlculady, the Image processing 
system according to the present invention is an image 
processing system in which information for identifying 
material is recorded In a recording medium or an exclu- 
sive-use recording serverto thereby relieve a burden on 
a photographer or an editor, and when material Is uti- 
lized, the material can be identified easily. 
[0056] Hereupon , a description will be made of a case 
where the image processing system accordirig to the 
present invention is applied to a step of producing a pro- 
gram in a broadcasting station and a program producing 
company. The stages for producing a program In a 
broadcasting station Include an anterior photographing 



state 1 0, a photographing producing stage 20, a poste- 
rior photographing stage 30, a broadcasting stage 40, 
and an archive stage 50. The image processing system 
according to the present invention gives rise to an ad- 

5 vantage that in the above-described stages ^ identifica- 
tion information for identifying image data and voice da- 
ta is suitably added and recorded in a recording medium 
or an exclusive-use recording device whereby when im- 
age data and voice data are utilized, these material data 

10 can be retrieved immediately to put it to practical use for 
editing or the like. 

[0057] It is noted that metadata can be mentioned as 
identification information to be added. The metadata 
termed herein is data for described information neces- 
15 sary for identifying material, for example, such as the 
gathering time, a gathering ID, a gathering title, and a 
reporter name. 

[0058] For example, a case where a news program is 
produced in a broadcasting station will be described with 
reference to FIG. 1 . Here, FIG. 1 explains a flow of work 
when a news program is produced, and is different from 
a so-called block diagram showing constitutional ele- 
ments of apparatus or the like. 

[0059] The news program production in a broadcast- 
ing station can be classified into five stages, as shown 
in FIG. 1 , pre-production 1 0, production 20, post-pro- 
duction 30, distribution 40, and archive 50. 
[0060] The pre-production 10 is a stage in which the 
persons concerned such as a producer, a director, an 
announcer, a gathering staff or the like make arrange- 
ments for broadcasting contents of a news program. In 
which stage, the decision of broadcasting items, the as- 
signment of a relay mobile, a gathering machine, a gath- 
ering crew or the like are also carried out. This is shown 
as a planning step 1 1 in FIG. 1 . 
[0061] The production stage 20 is principally a stage 
for collecting an Image and a voice, and in FIG. 1, ac- 
quisition step 21 , ingest step 22, and voice overstep 23 
correspond to the production stage 20. 
[0062] The acquisition step 21 shows "acquisition" for 
collecting an image and a voice. The ingest step 22 is 
a step of acquiring an image and a voice (hereinafter 
referred to as material) obtained by the acquisition. The 
ingest step 22 corresponds, for example, to archiving a 
video cassette tape or the like having material recorded 
in an archive shelf, or storing data of material in a ma- 
terial ingesting server The voice over step 23 is a step 
of inserting a voice such as narration Into an image. 
[0063] The post-production step 30 is a step of editing 
the collected materia! to. finish It Into a state that can be 
broadcast. In FIG. 1, computer graphic (CG) preparing 
step 31 and complete edit step 32 correspond to the 
post-production step 30. 

[0064] The computer graphic (CG) preparing step 31 
Is a step of preparing an image by the computer graph- 
ics, and preparing a map, a weather map, a letter or the 
like while being put on an image. The complete edit step 
32 is a step of editing material on the basis of contents 
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decided by the planning step 11 . 
[0065] The distribution stage Is a step of on-air 
(broadcasting) material edited, and in FIG. 1 , closed 
caption step 41 , live 42, automation step 43 and distri- 
bution step 44 correspond to the distribution stage 40. 
[0066] The closed caption step 41 shows a work step 
of preparing letters for letter distribution. The live 42 
shows a case where a relay at real time is broadcast 
during broadcasting of a news program. The automation 
step. 43 shows a work controlled by a computer to mix 
material edited, a closed caption signal and image data 
of the live 2 and produce a news program for broadcast- 
ing automatically. In the distribution step 44, a news pro- 
gram for broadcasting produced in the automation step 
43 is transmitted. 

[0067] The archive stage 50 is a stage for archiving 
Image data and voice data, and in FIG. 1 , near line ar- 
chive step 51 and archive step 52 correspond to the ar- 
chive stage 50. 

[0068] The near line archive step 51 shows a step of 
temporarily archiving material to be likely used one of 
these days out of materials edited. The archive step 52 
shows archiving material for a long period. 
[0069] NCS 60 shown in FIG.1 is a newsroom com- 
puter system, which is a system for generally adminis- 
trating information of the whole newsroom. In the NCS 
60, material administration such as administration of on- 
air items, and how individual material is processed in 
what stage, and buying and selling of material relative 
to a broadcasting station is also administrated. Further, 
in the NCS 60, a journalist sometimes prepares an arti- 
cle from a terminal connected to the NCS 60. 
[0070] Next, in a case where a news program is pro- 
duced, an example of metadata input in the aforemen- 
tioned steps is illustrated. Details of the data construc- 
tion of metadata will be described in detail later. 
[0071] First, in the planning step 11, the decision of 
broadcasting items, and the assignment of a relay car, 
a gathering machine and a gathering crew are earned 
out. In the planning step 11, broadcasting contents of a 
news program is studded, and metadata is input on the 
basis of contents studied. FIG. 2 shows an example of 
metadata. Metadata decided in the planning step 11 in- 
clude Gathering_Start_DateTime representative of pho- 
tographing start time, Gathering_End_DateTlme repre- 
sentative of photographing end time, 
Gathering_Location_Place representative of a photo- 
graphing location name, Photographer representative 
of a photographer name, Journalist Infonnation repre- 
sentative of information relating to a joum^itist, Director 
representative of a director for a news program, Produc- 
er representative of a producer for a news program , Title 
representative of a news gathering title, Contents hav- 
ing other information relating to photographing contents, 
and NCS ID as an identifier (ID) set every news program 
and broadcasting item registered in a newsroom com- 
puter system (NCS). 

[0072] In the planning step 11 , the metadata illustrat- 



ed above are written in a memory or the like provided 
on the NCO 60. It is noted that the metadata described 
in the planning step 11 are modified and suitably rewrit- 
ten in the step described later. 

5 [0073] Doing the course of shifting to the acquisition 
step 21 from the planning step 11 , metadata is transmit- 
ted to equipment for carrying out acquisition in the ac- 
quisition step 21, that Is, the image pick-up device. An 
example of metadata transmitted is shown In FIG. 3. It 

10 can be contemplated that the course shifting from the 
planning step 1 1 to the acquisition step21 termed herein 
is, for example, a period in which a relay car moves to- 
ward a gathering place. 

[0074] In this course, metadata representative of 
15 Gathering_Start_DateTime, 

Gathering_End_DateTime. Gathering_Locatlon_Place, 
Photographer, Journalist Information, Director, Produc- 
er, Title, Contents, and NCS ID are transmitted to an 
image pick-up device moving to a gathering place from 
a broadcasting station on the basis of contents of a news 
program studded in the planning step 11 . 
[0075] In the acquisition step 21 , gathering is carried 
out. In the image pick-up device for recording material 
data used in the acquisition step 21 , metadata received 
by a wireless communication are stored in a memory 
provided in the image pick-up device. The image pick- 
up device reads, when an image is photographed, the 
metadata from the memory to record it in the recording 
medium together with image data and voice data. At this 
time, the image pick-up device inputs, in addition to 
metadata transmitted from a broadcasting station, new 
metadata generated automatically. An example of meta- 
data input newly Is shown in FIG. 4A. 
[0076] Metadata input newly in the acquisition step 21 
include, In addition to the metadata shown in FIG. 3, 
Gathering_Location_Latitude (GPS latitude), Gathering. 
Location_Longitude (GPS longitude) and Gathering. 
Location.Altitude (GPS altitude) showing infomiation de- 
tected by GPS (Global Positioning System), Gathering^ 
Locatlon_Tlme (GPS Time) detected by GPS, 
Gathering_Location_Place (location name) representa- 
tive of a locatton name of a gathering place, machine ID 
which is ID every image pick-up device, Camera Setup 
Infonnation showing lens infonnation, Reel Number for 
Identifying a recording medium, Duration (Time) showing 
time required for photographing, SOM (Start Of Material) 
showing start time of each scene, Good Shot Mark and 
REC Start Mark, Audio Channel Information showing as- 
signment of a microphone, Audio Type showing a recoi-d- 
ing method for voice, UMID (Audio) and UMID (Video) for 
identifying material, and Copyright representative of cop- 
yright. 

[0077] The aboye metadata are input into a recording 
medium and an exclusive-use recording server. The 
above metadata modified in the stage of the acquisition 
step 21 are sometimes transmitted to SCS 60 for use. 
[0078] Material collected in the acquisition step are 
accumulated in the material recording server till chance 
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for use comes through the stage of the ingest step 22. 
FIG. 4B shows an example of metadata input into the 
recording medium in the Ingest step 22. 
[0079] In the ingest step 22, input are. In addition of 
the metadata shown in FIG. 4 A, Source representative 
of a supply source, STC (Start of Contents) represent- 
ative of start time of material data, Format showing a 
type of a data stream, Video Bit Rate showing a com- 
pression ratio of image, GOP (Group Of Pictures) Size 
showing a picture group in a case where image data ts 
MPEG compressed, Resolution representative of reso- 
lution, Audio Channel number representative of channel 
number of voice data, Audio Compression representa- 
tive whether or not voice data is compressed, Audio 
Sampling Rate representative of audio sampling fre- 
quency, Audio Data Size representative of size of.voice 
data, REC_Type showing a recording method, 
MaterlaLID as an identifier for identifying material used 
in the existing image processing system, Sub Key rep- 
resentative whether or not contents are modified when 
edited, UMID (Data) for describing Information relating 
to material data, UMID (System) representative of ID 
having UMID (Audio) and UMID (Video) collected. File 
Length which is represented by time of material, 
Essence_Size representative of size of the whole file, 
Object Type showing whether or not image date is a still 
picture, or voice data or image data, and Valid Date 
showing a valid date of material. 

[0080] The metadata shown in FIGS. 4A and 4B, in 
addition that is recorded along with Image data and 
voice data in the recording medium, are sometimes sep- 
arated from image data and voice data, and administrat- 
ed by the NCS 60. 

[0081] The metadata and material data produced and 
recorded In the respective stages of the planning step 
11, the acquisition step 21 and the ingest step 22 are 
used when rough editing and article preparation are ac- 
complished by a journalist. 

[0082] FIG. SB illustrates metadata used and Input 
when rough editing and article preparation are accom- 
plished by a journalist. FIG. 5A shows metadata input 
mainly in the image pick-up device, and FIG. SB shows 
metadata input mainly in the material acquisition step 
22. In addition to these, new metadata are further input, 
[0083] Gathering_Start_DateTime. 
Gathering_End_DateTlme, Gathering_Locatlon_Place, 
Photographer, Journalist Information, Director, Produc- 
er, Title, Contents, NCS ID, Gathering_Location_Latl- 
tude (GPD latitude), Gathering_Location_Longitude 
(GPS longitude), Gathering_Location_Altitude (GPS al- 
titude), Gathering_Location_Time (GPS Time), 
Gathering_Locatlon_Place (location name), machine 
ID, Camera Setup Infonnation, Reel Number, Duration 
(Time), SOM, Good Shot Mark & REC Start Mark, Audio 
Channel Infonnation, Audio Type, UMID (Audio), UMID 
(Video), Copyright, Source, STC, Format, compression 
ratio (Vkieo Bit Rate), GOP Size, Resolution, Audio 
Channel number, Audio Compression, Audio Sampling 



Rate, Audio Date Size, REC_Type, MateriaLID, Sub 
Key, UMID (Data). UMID (System), File Length. 
Essence_Size, Object Type, and Valid Date shown in 
FIG. 5A and FIG. SB are Input In the respective stages 
5 of the planning step 11, the acquisition step 21 and the 
material ingest step 22, these metadata being used in 
the rough editing. In addition to these data, there are 
metadata rewritten by the rough editing. 
[0084] Metadata Input newly In the stages of the rough 

10 editing and article preparation accomplished by a jour- 
nalist include EDL (Editing Decision List) Infomiatlon 
representative of infonnation relating to editing con- 
tents, and Script having an article manuscript described. 
[0085] In the complete edit step 32, based on the con- 

15 tents decided in the planning step 11 , the complete edit 
is performed by using the materials from the voice over 
step 23 and the materials ingested In the recording serv- 
er in the ingest step 22, and a news program Image 
(hereinafter called broadcasting material) to be broad- 

20 casted eventually is prepared. Alternatively, there is a 
case in which the CG image prepared in the CG combi- 
nation 15 and the material archived in the archive step 
52 and the near line archive step 51 are used. FIGS. 6A 
and 6B illustrate metadata used in the real editing. FIG. 

-25 6A shows metadata input in the image pick-up device, 
and FIG. 6B shows metadata input in the ingest step 22. 
New metadata are further input In addition to the former. 
Or contents of metadata are rewritten. 
[0086] Metadata of Gatherlng_Start_DateTime, 

30 Gathering_End_DateTime, Gathering_Location_Place, 
Photographer, Journalist Information. Director, Produc- 
er, Title, Contents. NCS ID, Gathering_Location_Lati- 
tude (GPD latitude), Gathering_Location_Longltude 
(GPS longitude), Gatherlng_Location_Alt(tude (GPS al- 

35 titude), Gathering_Location_Time (GPS Time), 
Gathering_Location_Place (location name), machine 
ID, Camera Setup Infonnation, Reel Number, Duration 
(Time), SOM, Good Shot Mari< & REC Start Mark, Audio 
Channel Infonnation. Audio Type, UMID (Audio), UMID 

40 (Video), Copyright, Source, STC, Format, compression 
ratio (Video Bit Rate), GOP Size, Resolution, Audio 
Channel number, Audio Compression, Audio Sampling 
Rate, Audio Date Size, REC_Type, MateriaMD, Sub 
Key, UMID (Data), UMID (System), File Length (Time) , 

45 Essence_Size (Byte), Object Type, and Valid Date, EDL 
Infonnation, and Script are produced by the rough edit- 
ing accomplished by the planning step 11 , the acquisi- 
tion step 21 , the material Ingest step 22 and the journal- 
ist, and or used. These metadata are used when editing 

50 of material is accomplished in the complete edit step 32 . 
[0087] There are also metadata rewritten by the com- 
plete editing out of metadata. In the complete edit step 
32, metadata mainly representative of EDL Information 
and Script are rewritten according to the edited con- 

55 tents, and are decided with the rewritten contents. 

[0088] On the other hand, in the CG preparation step 
31 , a weather map, a map. and letters displayed being 
put on an image by computer graphics are prepared. At 
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this time, the CG combined image plane is prepared au- 
tomatically on the basis of metadata showing position 
information. This behaviour is shown in FIG. 7. 
[0089] Metadata used include, for example, metadata 
showing position information such as Gathering^ 5 
Location_Latitude (GPD latitude), Gathering_Location_ 
Longitude (GPS longitude), Gathering_Location_ Alti- 
tude (GPS altitude), Gathering^Locatlon^Time (GPS 
Time) input by the image pick-up device in the acquisi- 
tion 21 stage, and metadata such as Script and Title. io 
[0090] A map of area corresponding to position infor- 
mation is extracted automatically from a data base stor- 
ing a map on the basis of metadata of Gathering_ 
Location_Latltude (GPD latitude), Gathering_Location_ 
Longitude (GPS longitude), Gathering_Location_Alti- '5 
tude (GPS altitude) recorded in material. Further, time 
Is displayed automatically on the basis of 
Gathering_Location_Tlme (GPS Time). 
[0091] The automatically prepared CG combined im- 
age plane can be edited freely by an editor in the CG 20 
combined GUI (Graphical User Interface) for editing. 
[0092] In the next automation step 43, in addition to 
an image edited, a closed caption produced in the 
closed caption step 41 , a CG combined image plane, 
image data broadcast to which a relay image from the 25 
live 42 is added, voice data and metadata are combined. 
[0093] Metadata combined with an Image and voice 
data and delivered are metadata produced and or used 
in the planning step 1 1 , the acquisition step 21 , the in- 
gest step 22, the rough editing by a journalist, and the 30 
complete edit step 32. 

[0094] Particularly, there can be mentioned 

Gathering_Start_DateTime, Gathertng_End_DateTime, 
Gathering_Location_Place, Photographer, Journalist In- 
fonnation. Director, Producer, Title, Contents, NCS ID, 35 
Gathering_Location_Latltude (GPD latitude), Gathe- 
rlng_Location_Longitude (GPS longitude), Gathering. 
Location_Attitude (GPS altitude), Gathering_Location_ 
Time (GPS Time), Gathering_Location_Place (location 
name), machine ID, Camera Setup Infomriation, Reel 40 
Number Duration (Time), SOM, Good Shot Mark& REC 
Start- Mark, Audio Channel Information, Audio Type, 
UMID (Audio), UMID (Video), and Copyright. Metadata 
required fora viewer who receives broadcasting material 
can be extracted out of Source, STC, Fonnat, compres- 45 
slon ratio (Video Bit Rate), GOP Size, Resolution, Audio 
Channel number, Audio Compression, Audio Sampling 
Rate, Audio Date Size, REC_Type, Material_ID, Sub 
Key, UMID (Data), UMID (System), File Length (Time) , 
Essence_Size (Byte), Object Type, and VaUdDate, EDL so 
Infomnation, and Script, and transmitted. 
[0095] A news program combined In the automation 
step 43 is broadcast (on-air) in the distribution 40. 
[0096] Image data, voice data and metadata after on- 
air are subjected to near line archive for a given period S5 
in the stage of the near line archive step 51 , and there- 
after archived for a long period in the stage of the archive 
step 52. Material archived is suitably extracted from a 



recording device for archive for use. 
[0097] At this time, additional information of material 
described as metadata is used as an identifier peculiar 
to material for identifying material. Further, by referring 
to additional information input as metadata, for example, 
an editor or a journalist is able to retrieve desired mate- 
rial immediately. 

[0098] The image processing system for carrying out 
image processing will be described in detail using FIG. 
8 on the basis of a flow of work as described above. The 
image processing system 1 comprises devices for car- 
rying out gathering, editing and archives of material (im- 
age and voice), and in the processing steps of the de- 
vices, additional information for identifying material in 
detail is Input in a recording medium or an exclusive-use 
recording server. Hereupon, particularly, a case where 
a news program Is produced is shown. 
[0099] The image processing system 1 comprises an 
image pick-up device 101 for recording an image and 
voice in a recording medium as image data and voice 
data, a portable telephone 102 for inputting additional 
information through a base station described later to 
transmit it to the image pick-up device 101 , a data ad- 
ministrative device 103 for transmitting additional infor- 
mation to the base station, and a base station 104 for 
relaying data transmitted from the data administrative 
device 103 to the portable telephone 102. 
[0100] Further, the image processing system 1 com- 
prises a recording medium casing 10 housing a record- 
ing medium therein for recording and or reproducing im- 
age data and voice data, a recording/reproducing de- 
vice 106 for reproducing data recorded in the recording 
medium, a monitor 107 for displaying images or the like 
operated and reproduced Jn the recording/reproducing 
device 1 06, a material accumulation device 108 for tem- 
porarily accumulating reproduced Image data and voice 
data, an editing device for editing material, and a mon- 
itor 110 for displaying operating and editing images in 
the editing device 109. 

[0101] Further, the image processing system 1 com- 
prises a joint administrative device 111 for carrying out 
material administration In the system, a press terminal 
112 in which a journalist inputs infomnation with respect 
to material, and an input/output terminal 113 connected 
to the other network to carry out input/output of infomia- 
tion. 

[0102] The image processing system 1 comprises a 
recording device for archive for archiving broadcasting 
material produced, an authoring terminal 115 for pro- 
ducing and adding information irrespective of a time axis 
of broadcasting material, a media caster 1 1 6 for adding 
data for distribution for distributing infomnation produced 
by the authoring terminal 1 1 5, a multiplexer 11 7 for mix- 
ing broadcasting material edited by the editing device 
109, information irrespective of time axis and data for 
distribution, a delivering image and vobe recording de- 
vice 118 for temporarily recording delivering broadcast- 
ing material, a delivery part 1 1 9 for delivering broadcast- 
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ing material produced by the multiplexer 11 7, a set top 
box 120 for receiving broadcasting material delivered 
from the delivery part 119, and a television receiver (TV) 
for receiving and displaying broadcasting material. 
[0103] Further, when photographing, accumulation, 5 
editing and archives of material out in the image pick- 
up device 101, the material accumulation device 108. 
the editing device 1 09, and the recording device for ar- 
chive 114, respectively, the image processing system 1 
records metadata showing identification information of io 
material together with image data and voice data (here- 
inafter referred to as material data) to thereby enable 
clear identification of material. 

[0104] FIGS. 9 to 11 show concrete examples of 
metadata input as additional infomnation. FIGS. 9 to 11 is 
show them in a divided fomn for convenience' sake, but 
these are a series of figures. 

[0105] In FIGS. 9 to 11, periods shown as symbols 
"F", "T", "Sh". "Sc", "M", and "P" represents modilied pe- 
riods of metadata. That is, "F" (Frame) is metadata mod- 20 
if ied in one frame period of an image photographed con- 
tinuously every 1/30 second.. T' (Take) is metadata 
modified every take."Sh" (Shot) Is metadata modified in 
a shot period. "Se" (Scene) is metadata modified in a 
scene period. "M" (Media) is metadata decided every re- 
cording medium. "P" (Project) is metadata decided eve- 
ry news program. 

[0106] In addition, FIGS. 9 to 11 show Japanese no- 
tation and English notation for explaining metadata. Fur- 
ther, metadata provided already by SMITE (Society of 30 
Motion Picture and Television Engineers, Inc.) show ac- 
tual values such as "07 01 05 02 04 00 00 00" in a col- 
umn of SMITE Dictionary. 

[0107] Metadata shown in FIGS. 9 to 11 will be ex- 
plained In detail. Gathering_Location_Latitude is meta- 35 
data representative of latitude detected by GPS (Global 
Positioning System). Gathering_Location_Longitude is 
metadata representative of longitude detected by GPS. 
Gathering_Location_Altitude is metadata representa- 
tive of altitude detected by GPS. Gathering_Location_ 40 
Time is metadata representative of time detected by 
GPS. Position information by GPS Is suitably generated 
from a GPS, receiving part 138 provided on an image 
pick-up device 101. Further, time information detected 
by GPS is expressed by UTC (Coordinated Universal 45 
Time; adjusted Greenwich r^ean time) and Includes 
Time Zone infonmation representative of a time differ- 
ence from UTC. For example, in Japan, since a time dif- 
ference from UTC is 9 hours, information showing +9 is 
included. so 
[0108] . Gathering_Location_Place is metadata repre- 
sentative of a location name of a gathering place. 
[0109] UMID (Audio) and UMID (Video) are ID decid- 
ed to be alone in the whole worid for identifying material. 
Details of UMID will be described later. 55 
[0110] UMID (Data) is metadata for describing infor- 
mation relating to material data, but is ID representative 
if image data is a still picture, or graphic, or a closed 



caption signal, and representative if voice data is MIDI 
(Musical Instrument Digital Interface). 
[0111] UMID (System) is ID in which UMID (Audio) 
and UMID (Video) to a material are collected. 
[0112] Photographer is metadata representative of a 
name of a photographer. Journalist Information is meta- 
data into which is written information relating to a jour- 
nalist in charge of gathering. Director is metadata rep- 
resentative of a director of a news program. 
[01 13] Good Shot Mark & REG Start Mark is metadata 
relating to a mark point input manually at the time of pho- 
tographing. 

[0114] Camera Setup Infonnatlon is metadata includ- 
ing, for example, set information of CCD (Charge Cou- 
pled Device) provided by an image pick-up device, lens 
data for describing a lens maker, a contraction value and 
a lens magnification, and a crane angle. Camera Setup 
Information is necessary partlculaHy In the stage of CG 
combination 15. 

[0115] Machine ID is metadata representative of an 
image ptek-up device used for gathering, and has an 
Identification number peculiar to every image pick-up 
device. 

[0116] Take Number is metadata modified in a take 
period. 

[0117] Material start time code (Start of Materia) Is 

metadata showing start time of each scene. 

[01 1 8] Contents are metadata into which is input other 

information relating to photographing contents. 

[01 19] Valid Date is metadata showing a valid date of 

material. 

[01 20] Audio Channel Information is metadata show- 
ing microphone channel infomnation. In Audio Channel 
Infonnation are described microphone infomnation, for 
example, such that 1 channel Is assigned to a reporter 
microphone, and that 2 channel Is assigned to a mating 
microphone. 

[0121] Audio Type is metadata showing if recording 
of voice is monophonic, stereo, or bilingual. 
[01 22] Source Is metadata representative of a supply 
source of image data if material supplied to a recording 
server is recorded in a recording medium and carried 
into a broadcasting station directly, or is transmitted from 
a gathering location by a satellite communication or a 
wireless connmunfcatlon, or is distributed from other 
broadcasting stations. 

[0123] Format is metadata showing a type of data 
stream if it is DV fomnat, or MPEG MP@ML fomnat, or 
MPEG 4:2P@ML fomnat. 

[0124] Video Bit Rate is metadata showing a com- 
pression ratio of image. 

[0125] Audio Number of Channel is metadata repre- 
sentative of a channel number of audio data. Audio 
Compression is metadata representative if audio data 
is compressed. 

[0126] Audio Compression is metadata representa- 
tive of a compression ratio of audio data. 
[0127] Audio Sampling Rate Is metadata representa- 
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tive of audio sampling frequency. 
[0128] Audio Date Size is metadata in which size of 
audio data is displayed by time or byte number 
[0129] REC_Type is metadata showing a recording 
method such as Auto, Manual, GPI, Endless, Open End, 
etc. 

[0130] MateriaLID is ID for identifying material used 
In the existing image processing system. That is, Mate- 
rial ID corresponds to UMID, and is not sometimes de- 
scribed. 

[0131] Sub Key is metadata showing Version, Seg- 
ment, Revision, etc., and shows if it is deformed during 
application of several edits with respect to material. 
[01 32] File Length (Time) is metadata in which length 
of material is expressed by time. 
[01 33] Gathering_Start_DateTlme is metadata repre- 
sentative of time starring photographing, and is ex- 
pressed by UTC. Gathering_End_ DateTime is likewise 
expressed by UTC, and is metadata representative of 
photographing end time. These time data include Time 
Zone information representative a time difference from 
UTC 

[01 34] REC_Start_DateTime is metadata in which ed- 
iting start time when broadcasting material is produced 
in the editing device 10 is expressed by UTC 
REC_End_DateTime is metadata in which termination 
time of editing is expressed by UTC. These time infor- 
mation include Time Zone information representative of 
a time difference from UTC. 

[0135] Recording_Operator is metadata representa- 
tive of information of an operator who carried out editing 
in the editing device 109. 

[0136] File_Owner is metadata representative of 
property right information of material data. 
[0137] Shot Number is metadata modified in a shot 
period. . 

[0138] Duration (Time) is metadata showing time re- 
quired for photographing. 

[0139] GOP Size is metadata showing, in a case 
where an image is compressed by the MPEG type, its 
compression ratio. • , 
[0140] Resolution is metadata representative of res- 
olutions such as 720*512. 720*480, 544*480: 480*480, 
and 352*480. 

[01 41 ] Essence_Size (Byte) is metadata In which size 
of the whole file Including image and voice data is ex- 
pressed y the byte number, that being sometimes ex- 
pressed by time. 

[0142] Object Type (Still, Audio, Video, Key Source) 
is metadata including data such as Still showing itimage 
data is a still picture, Audio and Video showing if it is 
audio data or video data, and Key showing Key Source 
showing indication for a telop. 

[0143] Index, Index Type, Index Memo is metadata for 
carrying out retrieving. 

[0144] Scene Number is metadata modified in a 
scene period. 

[0145] Recording Terminal. REC Port is metadata 
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representative of information relating to a terminal that 
canried out recording. 

[0146] Reel Number is metadata for identifying a re- 
cording medium in which image data Is recorded, which 
5 is produced, even the same tape, as Number which is 
different every time it is moved in and out of an image 
pick-up device. 

[01 47] Copyright is metadata showing copyright of im- 
age data photographed and recorded, into which are in- 

10 put an individual name or a broadcasting station name. 
[01 48] Modif ied_DateTlme is metadata showing date 
in which modification is added to broadcasting material 
edited in the editing device 109; OnAir_DateTfme is 
metadata showing date on which broadcasting material 

15 is on-aired; and Archive_DateTime is metadata showing 
date on which broadcasting material is archived. These 
are expressed by UTC Including Time Zone information. 
[01 49] Producer is metadata representative of a pro- 
ducer for a news program. 

20 [0150] Archive_Operator is metadata representative 
of information of an operator who carried out archiving 
of broadcasting material. 

[0151] Title is metadata representative of a program 
name using a photographing title or contents to be gath- 
25 ered (contents of material). 

[0152] Archive Terminal is metadata representative of 
information relating to a terminal that carried out archiv- 
ing of broadcasting material. 

[0153] NCS ID is ID (Identifier) set every news pro- 
30 gram item and program registered in NCS (Newsroom 
^Computer System). However. NCS ID does not show ID 
for getting access to NCS 60. 

[0154] EDL Information is metadata relating to editing 
contents. Concretely, an in-point and an out-point of im- 
35 age data used are shown by time or Reel Number, and 
are described as an editing point list. Further, Script is 
metadata mainly showing contents of a read original. 
[01 55] OnAir_Flag is metadata representative wheth- 
er or not the edited broadcasting material is on-aired; 
and OnAir_Counter is metadata representative how 
many times on-air is made. 

[0156] Archive_Flag is metadata representative 
whether or not material collected by gathering is ar- 
chived. 

[0157] Compile_Flag Is metadata representative of 
that material once archived is recorded again when the 
former is arranged again and process whether or not it 
is erased is carried out. 

[0158] Distribution_Flag is metadata representative 
50 whether or not broadcasting material is delivered from 
a broadcasting station other than own station. Also 
when buying and selling of material is carried out, its 
information is described. 

[0159] File_Status__Bit is metadata representative of 
55 status of material in the material accumulation device 
108 and the editing device 109. 

[01 60] The metadata as described above are input in 
the processing steps in the respective devices whereby 
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material can be identified clearly by additional informa- 
tion showing status of material. 

[0161] As a transmission format for transmitting im- 
age data, voice data and metadata In the image 
processing system 1, there is used SDI (Serial Digital 5 
Interface) which Is a digital data transmission fomnat 
standardized by SMPTE (Society of Motion Picture and 
Television Engineer, Inc.). FIG. 12A shows the constitu- 
tion of the whole SDI format data. 

[0162] The SDI fomnat has EAV (End of Video) region io 
of 4-dit showing end synchronism, ancil!ary(ANS) re- 
gion of 268-dot, SAV (Start of Video) region of 4-dot 
showing start synchronism, and an active video region 
of 1440-bit, which is constituted by line number 525. 
However, numeral in a parentheses indicates a value '5 
defined by PAL (Phase Alternation Line) system. 
[01 63] The active video region has a vertical blanking 
part (VBK^) of 9 lines, an optional blanking part (OBK^) 
of 10 lines, an active video part (OCV^), a vertical blank- 
ing part (VBK2) of 9 lines, an optional blanking part 20 
(OBK2) of 10 lines, and an active video region (ACV2). 
[0164] SDI is a so-called D1 format, which is a fomiat 
for transmitting non-compression digital data such as 
D2 format, in which voice data is stored in the ancillary 
region, and video data such as D1 and D2 are stored in ^5 
the active video region for transmission. In the SDI for- 
mat, metadata is inserted into the ancillary region and 
transmitted. 

[0165] FIG. 12B shows 1 line of the SDI fomriat. When 
transmitted, data of 1 line 10-bit width is subjected to 30 
parallel-serial conversion and transmission path coding 
and transmitted. 

[01 66] Further, as a transmission fomnat for transmit- 
ting image data, voice data, and metadata in the image 
processing system 1 , there may be used, in addition to 35 
the aforementioned SDI fomnat, SDTI (Serial Digital 
Transfer Interface) format for transmitting compression 
data compressed by MPEG system or DV system, and 
SDTI-CP (Serial Digital Transfer Interface - Content 
Package) fomiat in which the SDTI format is further linrv 40 
ited. 

[0167] FIG. ISA shows the data construction of the 
SDTI fomiat. The SDTI format has, similar to the SDI 
format, EAV (End of Video) region of 4-dit showing end 
synchronism, ancillary(ANS) region of 268rdot, and 45 
SAV (Start of Video) region of 4-dot showing start syn- 
chronism, but the active video region constituted by line 
number 525 in the SDI fomnat is defined as a payload 
region. However, a numeral in a parentheses shows a 
value defined by PAL (Phase Alternation Line). so 
[0168] The payload region in the SDTI fomnat has a 
blank data part (BDT,, BDTg) and data part (DT^, DTg) 
but the line number of each data part is not defined. 
[0169] FIG. 13B shows 1 line of the SDTI format. 
When transmitted by the SDTI fonmat, data of 1 line ss 
10-bit width is subjected to parallel-serial conversion 
and transmission path coding and transmitted. 
[0170] In the SDTI fomnat. SDTI header data of 53 



words into which a transmission source address, an ad- 
dress, and a line number CRC are inserted are con- 
tained in the ancillary region. In the SDTI fomnat, meta- 
data Is inserted into a region of a portion except SDTI 
header data of the ancillary region. 
[0171] FIG. 14 shows the data construction of a SD- 
TI-CP fomnat. The packet construction in SDTI-CP Is 
composed by further limiting the SDTI fomnat, in which 
the constitution of the payload is modified so that various 
data may be inserted easily. 

[0172] Data transmitted by the SDTI-CP format in- 
cludes MPEG (Moving pbture Expert Group) 2 Video 
Elementary Stream and the like, and various data such 
as auxiliary data including voice and metadata can be 
transmitted collectively. 

[0173] Data inserted into the payload are divided by 
"Items", and various data are inserted Into the items. 
Concretely, there are four items, System Item, Picture 
Item, Audio Item, and Auxiliary Item. 
[0174] The System Item has regions such as System 
Item Bitmap. Content Package rate. SMPTE Universal 
Label, Package Metadata Set, Picture Metadata Set, 
Audio Metadata Set, Auxiliary Metadata Set, etc. 
[0175] In the SDTI-CP fomnat, metadata are regions 
of Package Metadata Set, Picture Metadata Set, Audio 
Metadata Set, and Auxiliary Metadata Set of System 
Item and transmitted. 

[01 76] Metadata are proper data added to identify ma- 
terial such as image data and voice data, and are trans- 
mitted on the basis of data fomiat of KLV (Key Length 
Value) protocol and UMID (Unique Material Identifier) 
based on the SMPTE Standard. 

[0177] The KLV format is a data transmission fomnat 
provided with three regions, Universal Label Data Key 
of 16 bytes describing Universal Label Data, Value 
Length showing data length of metadata stored in a Val- 
ue region, and Value in which actual metadata corre- 
sponding to SMPTE Dbtionary. FIG. 15 shows the KEV 
format. 

[0178] The Universal Label Data Key is a data region 
for applying proper labelling to metadata stored. The 
Universal Label Data Key is further divided into a UL 
(Universal Label) Header region including Object ID of 
1 byte and UL (Universal Label) Size, a UL (Universal 
Label) Designators region including SMITE Design, 
Registry Design, Data Design and Reference Version, 
and a Data Element Tag regbn of 9 bytes. 
[0179] UMID is an identifier decided solely in order to 
identify image data, audio (voice) data and other mate- 
rial data. FIG. 16 shows the data construction of UMID. 
[0180] UMID is composed of Basic UMID as ID for 
identifying material data comprising a series of image, 
voice and metadata (hereinafter referred to as con- 
tents), and Extended UMID as a signature for identifying 
contents in material data. 

[0181] Basic UMID has a data region of 32 bytes, and 
is composed of a Universal Label region of 1 2 bytes, a 
Length Value region of 1 byte, an Instant Number region 
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of 3 bytes, and a Material Number region shown by 16 
bytes. 

[0182] The Universal Label region stores therein a 
synnbol for identifying digital data, details of which are 
standardized in SMITE-298M. The Length Value region 
shows length of UMID. Basic UMID is different in length 
of symbol from Extended UMID. The Length Value re- 
gion is shown, in case of Basic UMID, by 13h, and is 
shown, In case of Extended UMID, by 33h. The Instant 
Number region shows whether or not substitute process 
and editing process to material data are applied. The 
Material Number region has three regions and stores 
therein a symbol for dividing material data. 
[0183] Time Snap shown by 4 bytes shows a snap 
clock sample number a day, and shows preparing time 
of nnaterial data in clock unit. Rn (Random Number) of 
8 bytes is a randonn number for avoiding that a double 
number is attached, in a case where inaccurate time is 
set, or in a case where for example, a network address 
of equipment defined by IEEE (The Institute of Electrical 
and Electronics Engineer, Inc.) is changed. 
[0184] On the other hand, Extended UMID is com- 
posed of Time/Date Code of 8 bytes for identifying time 
and data by which material is produced, Spatial Co-or- 
dinates of 12 byes defining position information ex- 
pressed by latitude, longitude and altitude, Alphanumer- 
ic Code (Country) of byte defining country name 4 by 
letters of alphabet omitted or symbols, Alphanumeric 
Code (Organization) of 4 bytes defining an organization 
nanne by letters of alphabet omitted or symbols, and Al- 
phanumeric Code (User) of 4 bytes defining a user 
name that produced material: 

[0185] The above-descried Basic UMID and Extend- 
ed UMID include no metadata showing image size and 
generation number. Particularty, Material Number 
shows no status of material and other infomnation relat- 
ing to an Image of material. Metadata showing image 
size and generation number are transmitted on the basis 
of the KEV fonnat. 

[01 86] The image pick-up device 1 01 , the portable tel- 
ephone.1 02, the data administrative device 1 03, and the 
base station 104 will be explained In detail with refer- 
ence to FIG. 17. 

[01 87] The image pick-up device 1 01 receives meta- 
data through the base station 104 and the portable tel- 
ephone 102 from the data jidminist native device 103 
connected to the material administrative device 1 08. Ac- 
cordingly, the transfer of data between these devices 
corresponds to the case where the image pick-up device 
101 moving In the course of shifting to the gathering 12 
from the planning step 11 in FIG. 1 transmits metadata 
from the broadcasting station. 

[01 88] The image pick-up device 101 is a digital video 
camera, comprising at least an image voice Input part 
1 31 for inputting image and voice, an operating part 1 32 
for carrying out operation of the Image pick-up device 
101 and inputting of metadata. HDD (Hard disk Drive) 
133 in vifhich OS (Operating System) of a microcomput- 



er 140 described later is recorded, a recording part 134 
for recording at least an Image and voice with respect 
to the recording medium 105, a multiplexer 135 for mul- 
tiplexing an image and voice and other data, a memory 

5 136 for mainly storing metadata, a bluetooth device 137 
as a wireless interface relative to the portable telephone 
1 02, a GPS receiving part 1 38 for receiving a GPS (Glo- 
bal Positioning System) signal to detect position infor- 
mation, an antenna 139 for receiving the GPS signal, 

10 and a microcomputer 140 for summing up and control- 
ling the aforementioned constitution. 
[01 89] The Image voice input part 1 31 has a circuit for 
image picking-up in CCD (Charge Coupled Device) not 
shown, or a circuit for recording such as a microphone, 

15 in which the image and voice input are converted into 
Image data and voice data on the basis of Instructions 
from the microcomputer 140 to supply them to the mul- 
tiplexer 135. 

[0190] The operating part 132 has various buttons 
20 and switches not shown and carries out operation with 
respect to the image pick-up device 101 . Further, meta- 
data is input as necessary. 

[0191] In HDD 133 are recorded OS (Operating Sys- 
tem) of the microcomputer 140, and a software forcon- 

2s trolling the portable telephone 102. and the microcom- 
puter 140 suitably read these data for use; Further, In 
HDD 133, data Is written by the microcomputer 140. 
[0192] The recording part 134 has a recording/repro- 
ducing head for recording and or reproducing image da- 

30 ta, voice data and metadata In a recording medium 
though not shown, and records Image data being con- 
trolled by the microcomputer 140 and supplied from the 
multiplexer 135 in the recording medium. Further, the 
recording part 134 detects metadata described in the 

35 recording medium on the basis of Instructions from the 
microcomputer 140 to supply It to the microcomputer 
140. 

[0193] The multiplexer 1 35 is controlled by the micro- 
computer 140 and multiplexes Image data supplied from 
40 the image vok:e Input part 131 and metadata supplied 
from the microcomputer 140 to supply them to the re- 
cording part 134. 

[0194] The memory 136 is a so-called EPROM (Eras- 
able and Programmable ROM) which is erasable and 
45 programmable, which stores metadata supplied from 
the data administrative device 103 on the basis of In- 
structions from the microcomputer 140 Further, the 
memory 1 36 supplies metadata stored to the multiplexer 
135 on the basis of the instructions from the microcom- 
puter 140. 

[01 95] The bluetooth device 1 37 Is used as a wireless 
interface relative to the portable telephone 102, and is 
controlled by the microcomputer 1 40 to receive meta- 
data supplied from the data administrative device 
through the portable telephone 102. Further, the blue- 
tooth device 137 supplies tape position information out- 
put from the microcomputer 140 to the data administra- 
tive device through the portable telephone 102. 



so 



55 



14 

BNSDOCID: <EP 1187472A1_U>- 



27 



EP1 187 472 A1 



28 



[01 96] The bluetooth termed herein is a short distance 
wireless communication using a radio wave in 2.4 GHz 
band provided by Ericsson Ltd. (Sweden). The maxi- 
nr»um transfer speed of the bluetooth is 1 Mbit/sec., and 
as the modulation system, GFSK (Gaussian Frequency s 
Shift Keying) is used. Further, the maximum transferdis- 
tance of the bluetooth is 10m (output: ImW) and 100m 
(output: lOOmW), and the maximum transfer distance 
depends upon uses. 

[0197] The GPS receiving part 138 receives a GPS io 
signal through the antenna 139 to detect position Infor- 
mation of the Image pick-up device 101. The position 
information Is expressed as latitude, longitude and alti- 
tude. 

[0198] The microcomputer 140 houses therein, is 
though not shown, CPU (Central Processing Unit), RAM 
(Random-Access Memory), and ROM (Read Only 
Memory) to sum up and control the above-described 
conslitutions and to control operation of the whole digital 
video camera corresponding to a signal from the oper- 20 
ating part 1 32. Various metadata relating to photograph- 
ing are produced. 

[01 99] On the other hand, the data administrative de- 
vice 1 03 is a computer connected, for example, to a tel- 
ephone line network to enable communication with the 25 
joint administrative device 111, and is installed, for ex- 
ample, in a broadcasting station to which a photogra- 
pher who uses the image pick-up device 101 to carry 
out photographing belongs. A microcomputer 141 pro- 
vided on the data administrative device 103 sums up 30 
and controls the whole operation of the data administra- 
tive device 103. When the microcomputer 141 controls 
a communication part 142 and receives a signal from 
the image pick-up device 101 through the portable tel- 
ephone 102, the microcomputer 141 identifies a tele- 35 
phone number of the portable telephone 102 to recog- 
nize the Image pick-up device 1 01 being used by a pho- 
tographer who owns the portable telephone 1 02 as a 
transmission source. The data administrative device 
103 transmits metadata corresponding to the recog- ^0 
nized image pick-up* device 1 01 to the portable tele- 
phone 102. 

[0200] Metadata corresponding to the Individual Inv 
age pick-up device 101 transmitted are input In advance 
in the joint administrative device 111 shown In FIG. 8. 45 
The metadata are accumulated, for example, in HDD 
not shown provided in the joint administrative device 
111. 

[0201] The recording/reproducing device 106 shown 
in FIG. 8 is a device capable of reproducing image data so 
and voice data, and as a recording medium, particularly 
a digital video tape recorder is used. The constitution of 
the recording/reproducing device 106 will be explained 
with reference to FIG. 18. 

[0202] The recording/reproducing device 106 com- 55 
prises an input terminal 151 for inputting image data, 
voice data and metadata supplied in the SDI fomnat, an 
output tenninal 1 52 for outputting image data, voice data 



and metadata supplied in the SDI format, an input 
processing part 153 for extracting image data, voice da- 
ta and metadata from data input in the SDI format; a 
compression coding/decoding part 154 for carrying out 
compression coding and decoding (expansion) process 
of data, and an output processing part 155 for converting 
a signal decoded in the compression coding/decoding 
part 154 Into the SDI fomnat to supply it to the output 
terminal 152. The compression coding/decoding part 
1 54 carries out compression coding process using dis- 
crete cosine conversion. 

[0203] The recording/reproducing device 1 06 further 
comprises an error correction process part 156, a chan- 
nel coding part 1 57, and a recording/reproducing part 
158. The error correction process part 156 carries out 
addition of an error correction code to a signal compres- 
sion coded by the compression coding/decoding part 
154, and carries out error correction process with re- 
spect to a signal obtained by reproducing from the re- 
cording medium to output it to the compression coding/ 
decoding part 1 54. The channel coding part 1 57 carries 
out coding process suitable to be recorded in the record- 
ing medium with respect to a signal to which an error 
correction code is added by the error correction process 
part 1 56, and carries out decoding process correspond- 
ing to coding process with respect to an image signal 
reproduced from the recording medium to output It to 
the error correction process part 156.The recording/re- 
producing part 158 records a signal coded by the chan- 
nel coding part 157 In the recording medium, and repro- 
duces a signal recorded in the recording medium to out- 
put it to the channel coding part 1 57. 
[0204] The recording/reproducing device 1 06 further 
comprises a mechanism part 159 for carrying out load- 
ing of the recording medium casing 105 and driving of 
a recording/reproducing part 158, an operating part 1 60 
for carrying out various Inputs from a user, a terminal 
162 connected to a tenninal 105b of a non-volatile mem- 
ory 105a provided in the recording medium casing 105, 
and a controller 162. The controller 1 62 is connected to 
the compression coding/decoding part 154, the error 
correction processing part 1 56, the channel coding part 
157, the mechanism part 159. the operating part 160 
and the terminal 161. 

[0205] In the recording/reproducing device 106, the 
operating part 1 60 Is provided with a plurality of switches 
for carrying out predetenmined Instructions though not 
shown in detail. The plurality of switches include a 
switch for instructing a start point (a mark-in point) of a 
valid region in each scene or take, a switch for Instruct- 
ing OK, NG (No Good) to each scene or take, a disk 
switch for instructing a take number, and a switch for 
inputting other metadata. 

[0206] The controller 162 in the recording/reproduc- 
ing device 1 06 is composed of CPU (Central Processing 
Unit), ROM (Read Only Memory), RAM (Random Ac- 
cess Memory), and Input /output part though not shown, 
and executes a program stored in ROM with RAM as a 
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work region to thereby sum up and control the whole 
work of the recording/reproducing device 1 06 on the ba- 
sis of a time code signal. 

[0207] In the above-described recording/reproducing 
device 106, when image data recorded in the recording 
medium is reproduced, or when image data reproduced 
is recorded in the material accumulation device 108, 
identification information such as a mark-in point, a 
mark-out point, and other metadata can be input as nec- 
essary by the operation from the operating part 1 6 1 . The 
identification information is recorded in the non-volatile 
memory 105a and the recording medium together with 
image data. 

[0208] The material accumulation device 108 shown 
in FIG. 8 is a memory for temporarily accumulating ad- 
ditional Infonnation such as image data, voice.data and 
metadata reproduced from the recording/reproducing 
device 106. The constitution of the material accumula- 
tion device 108 will be explained with reference to FIG. 
19. In FIG, 19, the solid line indicates that image data, 
voice data and metadata are transmitted, and the bro- 
ken line indicates a low of a control signal. 
[0209] The material accumulation device 108 com- 
prises an Input process part 171 for inputting and sep- 
arating image data, voice data and metadata transmit- 
ted in the SDt fonnat, an encoder (ENC) 172 for coding 
image data and voice data, a recording part 173 for re- 
cording additional information of image data, voice data 
and metadata, a decoder (DEC) for carrying out decod- 
ing corresponding to the encoder, an output process 
part 1 75 for outputting the decoded image data, voice 
data and metadata in the SDI fonnat, and a controller 
170 for summing up and controlling various parts. 
[021 0] The input process part 1 71 extracts image da- 
ta, voice data and metadata from data input in the SDI 
format being controlled by the controller 176, and sup- 
plies image data and voice data to the encoder 1 72. The 
extracted metadata is supplied to the controller. 
[021 1 ] The encoder 1 72 is controlled by the controller 
1 76 to code image data and voice data input form the 
input process part 1 71 on the basis of a.MPEG system 
for compressing relatively between frames or a DV, 
JPEG system for compressing in a frame to supply the 
obtained signal to the recording part 1 73. 
[0212] The recording part 1 73 is a recording medium, 
for example, such as HDD (Hard Disk Drive), and 
records additional information such as image data, 
voice data and metadata. The recording part 173 inputs 
and records a compression stream coded in the encoder 
172. Such a recording part 173 may have an A/V data 
recording part for recording AA/ data (AudioA/ideo) data 
such as Image data and voice data, and an addition in- 
fomnation recording part for receding additional Infomna- 
tion such as metadata. 

[021 3] The decoder 1 74 is controlled by the controller 
1 76 to apply decoding process corresponding to coding 
In the encoder 1 72 with respect to data coded in the en- 
coder 172 to supply it to the output process part 175. 



[0214] The output process part 175 is controlled by 
the controller 176 to input image data and vobe data 
decoded in the decoder 1 74and metadata from the con- 
troller 176 to convert the data Into the SDI format to out- 
5 put it. 

[0215] The controller 176 is composed of CPU, ROM, 
RAM, an input/output part, and a memory to execute a 
program stored in ROM with RAM as a work region 
whereby summing up and controlling the whole work of 
the material accumulation device 108. The controller 
176 administrates metadata supplied from the input 
process part 1 71 . The controller 1 76 modifies metadata 
as necessary or produces new metadata. Further, the 
controller 1 76sends metadata to the output process part 
175. 

[0216] The editing device 109 shown In FIG. 8 is an 
editing device for editing Image data and voice data (ma- 
terial data) to edit material on the basis of metadata. The 
constitution of the editing device 109 will be explained 
with reference to FIG. 20. 

[0217] The editing device 109 comprises an input op- 
erating part 181 for carrying out operating input for var- 
ious editing, an input process part 182 for inputting ma- 
terial data transmitted in the SDI format, a recording part 
1 83 for recording image data, voice data and metadata, 
a voice mixer 1 84 for processing voice data, a special 
effect process part 1 85 for applying special effect proc- 
ess to image data, an output process part 1 86 for out- 
putting image data, voice data and metadata in the SDI 
format, a control part 1 87 for summing up and controlling 
various parts, a memory 1 88 for storing the edition result 
as metadata. 

[0218] The input operating part 181shows a mouse 
and a keyboard for editing material from GUI (Graphical 
User Interface) displayed on a monitor connected to the 
editing device 1 09. Operation for various editions, prep- 
aration of originals of articles, and edition of a CG com- 
bined image plane are carried out from the input oper- 
ating part 181. The input operation is carried out by the 
input operating part 181, and in aiddition, can be also 
carried outf rom the joint administrative devk;e 1 1 shown 
In FIG. 8. 

[0219] The input process part 1 82 is controlled by the 
control part 1 87 to input data from the material accumu- 
lation device 1 08 transmitted In the SDI format stand- 
ardized In SMPTE, and extracts Image data, voice data 
and metadata to supply them to a recording part 183 
described later. The image data and voice data out of 
the extracted data may be compressed in M PEG system 
making use of relations between frames or JPEG sys- 
tem and DV system which are compression In a frame 
in the compression process part not shown. Further, the 
input process part 182 extracts a CG image plane such 
as a map from a recording server not shown on the basis 
of metadata. 

[0220] The recording part 1 83 is a recording medium 
such as HDD (Hard Disk Drive) or RAID (Redundant Ar- 
ray of Inexpensive Disks) composed of a plurality of 
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HDDs, which records image data, voice data and meta- 
data from the input process part 1 82. 
[0221] The voice mixer 184 is able to input a plurality 
of voice data, simultaneously, supplied by an input sys- 
tem of a plurality of channels from the recording part 1 83 5 
to process voice data. For example, by gradually raising 
a voice level of the other voice data while gradually tow- 
ering a voice level of one voice data, one voice data can 
be shifted smoothly to the other voice data. The voice 
mixer 1 84 supplies the processed voice data to the re- io 
cording part 1 83. 

[0222] The special effect process part 185 is able to 
input, simultaneously, a plurality of image data supplied 
by an input system of a plurality of channels from the 
recording part 1 83. The voice mixer 1 84 is provided to ^5 
apply, for. example, special effect such as fade-in/fade- 
out of Image data. The special effect process part 1 85 
supplies image data having special effect process add- 
ed thereto to the recording part 1 83. 
[0223] The output process part 1 85 is controlled by a 
control part 187 to input edited image data, voice data 
and metadata from the recording part 1 83 to convert it 
to the SPI format for output. 

[0224] The control part 1 87 sums up and controls the 
above-described parts, and in addition, administrates 25 
metadata supplied from the input process part 1 82, and 
modifies contents of metadata as necessary or produc- 
es new metadata. Further, the control part 187 sends 
metadata to the output process. part 186. 
[0225] The memory 188 stores the edited result car- 30 
ried out in the voice mixer 184 and the special effect 
process part 1 85 as EDL_lnfonnation (EDL: Edition De- 
cision List) as metadata based on the edited result. Fur- 
ther, the memory 1 88 stores it as Script which is meta- 
data based on an article original input in the input oper- 35 
atlngpart 1 81 or metadata showing article contents. The 
prepared EDL_lnfonnatipn and Script are sent to the 
output process part 186. Hereupon the edited result 
shows information relating to an editing point in which 
an in-point and an out-point on the recording medium 40 
are expressed by Reel Nuniiber of a time code. 
[0226] The monitor 107 shown in FIG. 8 is provided 
to Input image data, voice data and metadata transmit- 
ted in the SDI format and carries out various displays 
relating to an image reproduced by the recording/repro- 45 
ducing device 106 and op(«ration. The monitor 107 
shown in FIG. 8 is provided to input image data, voice 
data and metadata transmitted in the SDI format and 
carries out displays of infonnation necessary for editing 
carried out by the editing device 1 09 and images, so 
[0227] The joint administrative device 111 shown in 
FIG. 8 sums up and administrates additional infonnation 
such as image data, voice data and metadata in the im- 
age processing system 1 and the whole infonnation in 
producing a news program, which corresponds to NCS 55 
60 shown in FIG. 1 . Concretely, the joint administrative 
device ill carries out administration of on-air Items and 
material administration if what material receives what 



stage of process, and in addition, carries out adminis- 
tration of buying and selling of material relative to other 
broadcasting stations through an input/output terminal 
1 1 3 conceited to the joint admin istrative device 111. Fur- 
ther, an article prepared by a journalist is input from a 
journalist terminal 112 connected to the joint adminis- 
trative device 111. 

[0228] The journalist terminal 112 and the input/out- 
put tenninal 113 shown in FIG. 8 is in a relation of the 
joint administrative device 111 and a host, a client, and 
can be connected to the joint administrative device 11 
as a host computerto perform various input/output wort< 
with respect to the joint administrative device 111 . The 
input/output terminal 113 can be connected to an exter- 
nal network to carry out exchange of various data be- 
tween other terminals present in the extemal network, 
and buying and selling of various data as the case may 
be. Information of exchange and buying and selling of 
various data is administrated by the joint administrative 
device 111. 

[0229] The recording device for archive 114 shown in 
FIG. 8 is a device for archiving broadcasting material 
edited, which is provided with a recording medium, for 
example, such as HDD. Although not shown, the record- 
ing device for archive 114 may comprise a long period 
recording part for archiving broadcasting material for a 
long period, and a temporary recording part for archiv- 
ing, for a given period, broadcasting material having 
possibility of being used again during a given period. 
The recording device for archive 1 1 4 is designed to tak- 
en out broadcasting material being recorded freely in re- 
sponse to a request from the editing devfce 1 0 and the 
joint administrative device 111 . 

[0230] The authoring terminal 115 shown in FIG. 8 is 
a terminal for adding Information different from broad- 
casting material on the time axis, such as shopping In- 
formation relating to, for example, dress worn by a per- 
fomrier or a watch put on. 

[0231 ] The media caster 1 1 6 shown in FIG. 8 is a ter- 
minal for adding additional Infonnation, for example, 
such as a home page address of a store selling dress 
and watches, relating to infonnation different in time axis 
added by the authoring tenninal 115. 
[0232] The multiplexer 117 shown in FIG. 8 mixes a 
signal relating to additional Infonnation from the media 
caster 116 and a signal of broadcasting material in the 
SDI formal from the editing device 109 to produce 
broadcasting material which is delivered finally, that is, 
as a program constitution for a viewer. The multiplexer 
1 1 7 supplies the broadcasting material to a delivery part 
119. 

[0233] The delivering image and voice recording de- 
vice 118 shown in FIG. 8 temporarily records delivering 
broadcasting material constituted in the SDI fonriat sent 
from the editing device 109, and is provided with a re- 
cording medium such as HDD The delivering image and 
voice recording device 118 supplies broadcasting ma- 
terial to the delivery part 119. 
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[0234] The delivery part 119 delivers broadcasting 
material supplied from the multiplexer 117 and the de- 
livering image and voice recording device 118. The de- 
livery part 119 extracts metadata, particularly metadata 
which seems to be necessary on the receiving side out 
of metadata supplied in the SDI fomnat to deliver it to- 
gether with image data and voice data. 
[0235] The above-described constitution corre- 
sponds to a broadcasting station for producing and 
transmitting broadcasting material, whereas the set top 
box 120 and the television 121 are provided on the side 
for receiving broadcasting material supplied from the 
broadcasting station. 

[0236] The set top box 1 20 is a connection device for 
connecting various communication terminals, which is 
a receiving device provided with a bidirectional commu- 
nication function, an Internet connection function, and a 
CATV connection function. The set top box 1 20 receives 
an electric wave of broadcasting material delivered from 
the delivery part 119 to supply It to the television 121. 
The television 121 processes a signal supplied to dis- 
play it. 

[0237] In the following, operation of the respective de- 
vices when a news program is produced using the afore- 
mentioned image processing apparatus 1 will be ex- 
plained. First, contents of gathering are decided In the 
stage of the planning step 11 shown in FIG. 11. In the 
joint administrative device 111 shown in FIG. 8, meta- 
data relating to the gathering are input on the basis of 
the gathering contents. In the joint administrative device 
111, the metadata are transmitted to the data adminis- 
trative device 103 for transmitting the metadata to the 
image pick-up device 101 going to gathering. Metadata 
are transmitted to the image pick-up device 101 by the 
data administrative device 1 03. 

[0238] First, operation of the image pick-up device 
101 will be explained with reference to FIG. 21 . When 
the operating part 132 is operated In a predetemriined 
timing by a user who takes photograph using the image 
pick-up device 101 to Indicate a transfer request of 
metadata,, the microcomputer 140 of the image pick-up 
device 101 controls, in Step SI, the bluetooth device 
137 to request through the portable telephone 102 that 
the data adrfiinistrative device 1 03 transfer metadata to 
the bluetooth device 137. 

[0239] The metadata transf«srred Is metadata decided 
in the stage of the planning step 11 shown in FIG. 1. 
Concretely, this corresponds to metadata representa- 
tive of a gathering location name, a photographer, a jour- 
nalist, a director, a description relating to contents, gath- 
ering start date time, gathering end date time, a produc- 
er, a news gathering item, and NCS ID. 
[0240] However, out of the above-described metada- 
ta, metadata other than the description relating to con- 
tents and the news gathering item are metadata input 
temporarily, which are suitably modified In the step de- 
scribed later 

[0241] This metadata is input every image pick-up de- 
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vice before starting gathering from the material admin- 
istrative device 108 on the basis of the gathering plan 
before gathering, and is stored in advance in the record- 
ing part of the material administrative device 108 not 

5 shown in FIG. 8. 
. [0242] The individual image pick-up device is as- 
signed in advance, and Is recognized by ID stored in the 
memory 136, or the telephone number of the portable 
telephone together with the image pick-up device 1 01 . 

10 Accordingly, metadata of a plurality of image pick-up de- 
vices are controlled every machine ID of the image pick- 
up device or the telephone number of the portable tele- 
phone 102. 

[0243] Metadata shown in FIG. 22 is for the image 
'5 pick-up device 1 01 used for gathering together with the 
portable telephone 102 whose telephone number Is, for 
example, "090-xxxx-xxxx". 

[0244] In this case, as the gathering start date time, 
"2000/3/3 9:00-10:00", "2000/3/3 13:00-14:00", and 
"2000/3/3 17:00-19:00" are shown, and NCS ID corre- 
sponding thereto are shown as in "0001", "0002", and 
"0003". Corresponding to the NCS ID, as news gather- 
ing titles, there are shown "Prime minister interview", 
"Street interview", and "Press club gathering". Similarly, 
a photographer and a journalist are shown correspond- 
ing thereto. 

[0245] Hereupon, the process in the data administra- 
tive device 103 when transfer of metadata is requested 
from the image pick-up device 101, in the step of Step 
SI , will be explained with reference to FIG. 23. 
[0246] When a request of metadata from the image 
pick-up device 101 is received through the portable tel- 
ephone 102, the data administrative device 103 recog- 
nizes, in Step S21 , the telephone number of the portable 
telephone 1 03 transmitting the received metadata oi'the 
machine ID of the image pick-up device 10. 
[0247] In Step S22, the data administrative device 
103 transmits, out of metadata of the image pick-up de- 
vice 1 01 corresponding to the telephone number of the 
portable telephone 102 received, metadata correspond- 
ing to the time received to the portable telephone 102. 
For example, supposing that the image pick-up device 
101 requests transfer of metadata at 9:00 on March 3, 
2000, the data administrative device 103 transmits 
metadata representative of a news gathering title "Prime 
Minister Interview", a photographer and a journalist cor- 
responding to NCS ID "0001 " corresponding to that time 
to the image pick-up device 101 through the portable 
telephone 1 02. 

[0248] Now returning to FIG. 21 , a descrijation will be 
made. In Step S2, the bluetooth device 137 receives 
metadata from the data administrative device 103 
through the portable telephone 1 02, and notifies the mi- 
crocomputer 140 the reception thereof. 
[0249] In Step S3, the microcomputer 140 receives a 
notice telling that metadata are received from the blue- 
tooth device 137, and temporarily stores the metadata 
received by the bluetooth device 1 37 In the memory 1 36 , 



EP1 187 472 A1 



25 



30 



35 



40 



45 



SO 



3NSDOCI0:<EP 1187472A1 I > 



18 



35 



EP1 187 472 A1 



[0250] In Step S4. the microcomputer 140 judges 
whether or not recording is started, and If judgement is 
made that recording is not started, the procedure pro- 
ceeds to Step S5. and in a case where the status of re- 
cording standby is released, the microcomputer 140 ter- 
minates its process. On the other hand, In a case where 
recording standby is not released, the procedure returns 
to the step of Step S4. That Is, th image pick-up device 
101 repeats the processes of Steps 84 and S6 tiil re- 
cording standby is released to assume status of record- 
ing start waiting. 

[0251] In Step S4. when judgment Is made that re- 
cording is started, the procedure proceeds to Step S6, 
the microcomputer 140controls the recording part 134 
to read a time stamp at a recording start point of the 
recording medium to store it in the memory 136, and 
controls the bluetooth device 137 to transmit it to the 
data administrative device 1 03 through the portable tel- 
ephone 102. 

[0252] Further, the microcomputer 140 controls the 
image voice input part 131 to output image data to the 
multiplexer 135, and controls memory 136 to output 
metadata stored in the memory 136 to the multiplexer 
135. 

[0253] In Step S7, the microcomputer 1 40 controls the 
multiplexer 135 to multiplex image and voice data and 
metadata to supply them to the recording part 1 34 In the 
SDI format. 

[0254] In Step SB. the recording part 1 34 records data 
In the SDI format having image data, voice data and 
metadata supplied from the multiplexer 1 35 multiplexed 
in the recording medium. 

[0255] In Step S9, the microcomputer 140 judges 
whether or not recording is ended, and in a case where 
recording is not ended, status of recording end waiting, 
that is, recording status is continued. 
[0256] On the other hand, when judgement Is made 
that recording is ended in Step 89, the microcomputer 
1 40 controls, in Step SI 0, the recording part 1 34 to read 
a time stamp showing a recording end point of the re- 
cording mediurn^ and-controls the bluetooth device 137 
to transmit tape position information of the recording 
start point-and the recording end point read to the data 
administrative device 103 through the portable tele- 
phone 1 02 to end the process. 

[0257] The recording medium shown In FIG. 8 Is, for 
example, a tape-like magnetic recording medium, par- 
ticularly showing a digital video tape. The recording me- 
dium is able to record image and voice as digitalized 
image data and voice data, and is provided with a region 
capable of recording auxiliary data such as metadata 
other than Image data and vobe data. Further, the non- 
volatile memory 1Q5a may be provided on the recording 
medium casing 1 05 so that auxiliary data is stored in the 
non-volatile memory 1 05a. 

[0258] In the following, there will be explained the 
process when the data administrative device 103 re- 
ceives tape position information from the Image pick-up 
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device 101. When the data administrative device 103 
receives tape position infomnation from the image pick- 
up device 101 in Step S10 of FIG. 21 , the data admin- 
istrative device 103 recognizes the telephone number 
5 of the portable telephone 102 which is a transmission 
source of the received tape position infomnation in Step 
S31 shown in FIG. 24. 

[0259] In Step S32, the data administrative device 
103 adds the above tape position information to meta- 
10 data corresponding to the recognized telephone 
number out of metadata recorded in HDD not shown to 
record it. 

[0260] While in the above explanation, a description 
has been made illustrating a photographer, a journalist, 
gathering state date time, a news gathering Item, and 
NCS ID out of a gathering location name, a photogra- 
pher, a journalist, a director, description relating to con- 
tents, gathering state date time, gathering end date 
time, a producer, a news gathering item, and NCS ID, it 
is noted that the same is true for a director, description 
relating to contents, gathering end date time, and a pro- 
ducer. 

[0261] Further, there is metadata produced by the im- 
age pick-up device 1 01 , added automatically and input. 
Concretely, the metadata are metadata, out of those 
shown in FIGS. 9 to 11 , representative of gathering po- 
sition (GPS latitude), gathering position (GPS longi- 
tude), gathering position (GPS altitude), gathering posi- 
tion (GPS time), a gathering location name, UMID (vid- 
eo). UMID (audio), a photographer, a journalist, a good 
shot marker, camera set up infomnation, machine ID, a 
take number, a material start code, description relating 
to contents, an audio channel division, an audio type, 
gathering start date time, gathering end date time, a file 
owner, a shot number, a recording temriinal, a recording 
port, right, and a news gathering title. 
[0262] By recording metadata representative of infor- 
mation relating to material and tape position infonmation 
in the recording medium and the data administrative de- 
vice 103 as described above, it is possible to immedi- 
ately retrieve and edit material data recorded In the re- 
cording medium. . 

[0263] Material data and metadata collected by the 
image pick-up device 101 and recorded In the recording 
medium are reproduced by the recording/reproducing 
device 106 shown In FIG. 8 and supplied as data of the 
SDI format to the material accumulation device 108. In 
the material accumulation device 1 08, image data, voice 
data and metadata transmitted in the SDI fomnat are re- 
spectively separated and recorded in the recording part 
173. 

[0264] The controller 1 76 modifies contents of meta- 
data as necessary, and produces new metadata. Meta- 
data produced newly are metadata representative of 
UMID (video), UMID (audio), UMID (data), UMID (sys- 
tem), a good shot marker, a take number, a gathering 
start time code, description relating to contents, a valid 
date, an audio channel division, an audio type, source 
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information, a recording format, a compression ratio, an 
audio channel number, an audio compression ratio, an 
audio sampling frequency, audio data size, a recording 
method, material ID. a sub-key, length of a file, gathering 
start date time, gathering end date time, a recording op- 5 
erator, a file owner, a shot number, a gathering period, 
GOP size, resolution, essence size, an object type, in- 
dex, kind of index, an index memo, a sene number, a 
reel number, right, NCS ID, and a file status shown in 
FIGS. 9 toll. 10 
[0265] As described above, the material accumula- 
tion device 108 adds, when material is temporarily ac- 
cumulated, metadata as described above to the record- 
ing part 1 73 of the material accumulation device 1 08 and 
the recording medium to input them whereby material 15 
can be Identified clearly, and material data can be im- 
mediately retrieved and edited. 

[0266] ^ Image data, voice data and metadata recorded 
temporarily in the material accumulation device 108 are 
sent to the editing device 109 at timing according to ne- 
cessity. 

[0267] On the other hand, in the press temiinal 112 
connected to the joint administrative device 111, rough 
editing and article preparation are carried out by a jour- 
nalist. When rough editing is carried out and an article 25 
prepared through the press terminal 112 is input, an ed- 
iting decision list, and metadata representative of script 
shown In FIGS. 9 to 11 are added and Input. 
[0268] Further, the editing device 1 09 uses, out of the 
above-described metadata, metadata representative of. 30 
for example, gathering position (GPS latitude), gather- 
ing position (GPS longitude), gathering position (GPS 
altitude), gathering position (GPS time), a news gather- 
ing title, and script to prepare a CG combined image 
plane automatically. In the press terminal 112, a journal- 35 
1st may cany out rough editing on the basis of the CG 
combined image plane prepared automatically to edit 
the CG combined image plane freely. 
[0269] The automatically combined CG combined im- 
age plane is further edited by an operator operating a 40 
GUI (Graphical User Interface) image plane. Operation 
of editing in the GUI Image plane will be.explained with 
reference to FIGS. 25, 26 and 27. 
[0270] FIG. 25 schematically shows a GUI image 
plane 200 for editing a CG combined Image plane pre- -^s 
pared automatically. In FIG. 25, an image 201 shows a 
frame for staring CG combination. An image 202 shows 
a frame for ending CG combination. A combined image 
203 shows a CG combined image plane pr epared auto- 
matically. A manual selection button 204 Is a button for so 
carrying out selection for switching to an image plane 
on which position change for combining CG is carried 
out manually. A template selection button 205 is a button 
for changing combined position of CG. Templates 206, 
207, 208, 209, 210 and 211 show the respective pat- ss 
terns of combined position of CG. In FIG. 25, It is dis- 
played by a position pattern of the template 208 to which 
a frame is attached. A scroll bar 212 is a scroll bar for 



selecting templates 206 to 211 . 

[0271] Editing of CG combined image plane is carried 
out on the basis of steps shown in FIG. 26 and FIG. 27. 
The steps shown In FIG. 26 and FIG. 27 show a process 
in which the template selection button 205 is selected, 
and the CG combined image plane is displayed on the 
basis of the prepared template. 

[0272] A process for synthesizing and displaying a 
map relating to image data will be explained with refer- 
ence to FIG. 26. In Step 840. image data and metadata 
representative of position information are input. Then, 
in Step S41 , a map corresponding to position informa- 
tion is read out of a recording server recording a map or 
the like not shown on the basis of position Information 
shown by metadata. In Step S42. a CG combined Image 
plane is prepared automatically. 

[0273] Then, in Step S43, when a change of a tem- 
plate is instructed, the CG combined Image plane based 
on the template is displayed in accordance with the in- 
structions in Step S44. 

[0274] On the other hand, a process for synthesizing 
and displaying time information relating to image data 
or a title is shown with reference to FIG. 27. For time 
infomriation, title or the like, metadata representative of 
time information and metadata representative of a title 
are used. That is, in Step S50, image data and metadata 
as time information and title information are input. Then, 
in Step S51 , a CG combined image plane is prepared 
automatically. 

[0275] Then, when in Step S52, a change of a tem- 
plate is instructed , the CG combined image plane is 
changed in accordance with the instructions and dis- 
played in Step S53. 

[0276] For example, information of time ihfonnation, 
the form of a character of a titlei character size and the 
like are sometimes read from a recording server and dis- 
played. 

[0277] As described above, by using metadata show- 
ing position infomiation decided by GPS and metadata 
showing contents of an article, it Is possible to extract 
map information and characters displayed on the image 
plane and to carry out the CG combined image plane 
automatically using the extracted characters. 
[0278] Following the rough editing, the complete ed- 
iting Is can-led out in the editing device 10. In the com- 
plete editing, further strict editing is carried out In order 
to place material roughly edited In an actually broadcast- 
ing state. With the editing, concretely, metadata repre- 
sentative of a director, a producer, and an editing deci- 
sion list out of metadata shown in FIGS. 9 to 11 are new- 
ly input. With respect to metadata other than those de- 
scribed above, metadata used in the previous stages or 
metadata input in the previous stage are used again. In 
the complete editing, various information described as 
metadata are used for editing. 

[0279] Metadata representative of EDL Infonnatlon, 
Script input in the press terminal 112 is decided in the 
complete editing process in the editing device 109. 
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[0280] Broadcasting material edited in the editing de- 
vice 109 is mixed with other information added in the 
authoring temriinal 115 and the media caster 116 in the 
multiplexer 1 1 7 and sent to the delivery pat 11 9 in FIG. 8. 
[0281] The process for delivering broadcasting mate- 
rial from the delivery part 1 1 9 corresponds to the broad- 
casting step 44 in FIG. 1 . In the delivery part 119, meta- 
data representative of change date time and a distribu- 
tion flag are newly input. With respect to the above-de- 
scribed metadata, metadata used in the previous stage 
or metadata input in the previous stage is used again in 
the broadcasting step 44. 

[0282] When delivered from the delivery part 119, 
metadata needed on the receiving side out of metadata 
shown in FIGS. 9 to Hare extracted and transmitted. 
a[0283] Broadcasting material is recorded, after deliv- 
ery, in the recording device for archive 114, and admin- 
istrated by the joint administrative device 111. Metadata 
input newly when broadcasting material Is recorded in 
the recording device for archive 1 1 4 include archive date 
time, an archive operator, an archive terminal, an ar- 
chive flag, and a compile flag. 

[0284] With respect to metadata other than those de- 
scribed above, metadata used in the previous stage or 
metadata input in the previous stage are used again in 
the archive stage. 

[0285] According to the Image processing system 1 
described above in detail, when a news program is pro- 
duced In a broadcasting station, in the respective stages 
of the prior-photograph stage 10, the photograph pro- 
ducing stage 20, the post-photograph stage 30, the 
broadcast stage 40, and the archive stage 50, metadata 
for identifying image data and voice data is recorded in 
the recording medium or the recording device, and 
therefore, a burden on a photographer and an editor can 
be relieved. Further, when an editor handles material, 
the material data can be immediately retrieved and ed- 
ited. 

[0286] While in the above explanation, a description 
has been made of an example in which the bluetooth 
device, 137 is used for communication between the im- 
age,plck-up device 1 01 and the portable telephone 1 02, 
;it is rioted that communication between the image pick- 
up device 101 and the portable telephone 102 may be 
carried out by arranging a serial port and a modem by 
wire. Even in this case, the p^rocess by the image pick- 
up device 101 and the data administrative device 1 03 is 
similar to the case described previously. 
[0287] Further, a series of processes described above 
can be done by hardware, but can be also done by soft- 
ware. In a case where a series of processes are execut- 
ed by software, the software is installed, from a record- 
ing medium, on a computer in which a program consti- 
tuting the software is Incorporated in an exclusive-use 
hardware, or for example, a general personal computer 
capable of causing various functions to execute by in- 
stalling various programs. 

[0288] This recording medium is not only presented 



to a user in the state that being incorporated in advance 
in the image pick-up device 101 as HDD 133, but also 
is presented as a recording medium having a program 
recorded. The recording medium includes recording 
5 media such as a magnetic disk, an optical disk, a pho- 
tomagnetic disk, or a semiconductor memory. 

Industrial Applicability 

10 [0289] An image processing apparatus according to 
the present invention comprises an input part for input- 
ting image data, an image receiving part for receiving 
production information relating to production transmit- 
ted form another apparatus, a recording part for record- 
ing production information received by the receiving part 
and image data input by the input part in a recording 
medium, a detection part for detecting a recording po- 
sition of an editing point of image data recorded by the 
recording part on the recording medium, and a trans- 
mission part for transmitting information of the recording 
position detected by the detection part. 
[0290] Accordingly, when the image processing appa- 
ratus according to the present invention as described is 
applied, particularly, to a system for producing a pro- 
gram in a broadcasting station, various identification in- 
formation such as identification information for identify- 
ing image data and voice data, infonnation relating to 
copyright and so on can be recorded in a recording me- 
dium together with image data and voice data. Further, 
a burden when a photographer or an editor carries out 
photographing and or editing is relieved and conven- 
ience is improved. 

[0291] Further, an image processing apparatus ac- 
cording to the present invention comprises an input step 
of inputting image data, a receiving step of receiving pro- 
duction information relating to production transmitted 
form another apparatus, a recording step of recording 
production information received by the receiving step 
and image data input by the input step in a recording 
medium, a detection step of detecting a recording posi- 
tion of an editing point of Image data recorded by the 
recording step on the recording medium, and a trans- 
mission step of transmitting infomnation of the recording 
position detected by the detection step. 
[0292] Accordingly, when the Image processing appa- 
ratus according to the present Invention as described is 
applied, particularly, to a system for producing a pro- 
gram in a broadcasting station, various identification in- 
formation such as identification information for identify- 
ing image data and voice data, infonnation relating to 
copyright and so on can be recorded in a recording me- 
dium together with image data and voice data. Further, 
identification infonnation is recorded together with im- 
age data and voice data whereby a burden when a pho- 
tographer or an editor carries out photographing and or 
editing is relieved and convenience is Improved. 
[0293] Further, a recording medium having a program 
recorded, the program controlling an image processing 
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apparatus for recording image data in a recording me- 
dium according to the present invention, the receding 
medium having a program for causing a computer to ex- 
ecute a process including an input control step of con- 
trolling an input of image data, an incorporation control 
step of controlling an Incorporation of production infor- 
mation relating to production transmitted from another 
apparatus, a record control step of controlling recording 
of production information whose incorporation is con- 
trolled in the incorporation control step and image data 
input in the input control step to the recording medium, 
a detection control step of controlling detection of a re- 
cording position of an editing point of image data record 
in the record control step on the recording medium, and 
a transmission control step of controlling transmission 
of Information of the recording position detected In the 
detection control step to another apparatus. 
[0294] Accordingly, when a program recorded in the 
recording medium according to the present invention as 
described is applied, particularly, to an image pick-up 
device in a broadcasting station, identification infomna- 
tion for identifying image data and voice data, informa- 
tion relating to copyright and so on, and another Identi- 
fication information can be recorded in a recording me- 
dium together with Image data and voice data. Further, 
identification Information is recorded together with im- 
age data and voice data whereby a burden when a pho- 
tographer or an editor carries out photographing and or 
editing Is relieved and convenience is Improved. 
[0295] Furthermore, an image processing apparatus 
according to the present invention comprises an input 
part for inputting production infomriation relating to pro- 
duction by another apparatus, a storage part for storing 
production information Input by the input part corre- 
sponded to another apparatus, a transmission part for 
transmitting production information stored in the storage 
part to another apparatus, a receiving part for receiving 
position infonnation of an editing point of image data re- 
corded in a recording medium on the recording medium, 
and an adding part for adding position Information re- 
ceived by the receiving part to production infomriation 
stored in the storage part. 

. [0296] Accordingly, when the image processing appa- 
ratus according to the present invention as described is 
applied, particularly, to an image pick-up device in a 
broadcasting station, Identification Information for Iden- 
tifying image data and voice data, information relating 
to copyright and so on, and another identification infor- 
mation can be recorded in a recording medium together 
with Image data and voice data. Further, Identification 
information is recorded together with image data and 
voice data whereby a burden when a photographer or 
an editor carries out photographing and or editing is re- 
lieved and convenience is Improved. 
[0297] Furthermore, an image processing method ac- 
cording to the present invention includes an input step 
of inputting production infonnation relating to production 
by another apparatus, a storage step of storing produc- 



tion infonnation input by the input step corresponded to 
another apparatus, a transmission step of transmitting 
production information stored in the storage step to an- 
other apparatus, a receiving step of receiving position 
5 information of an editing point of image data recorded 
in a recording medium on the recording medium, and an 
adding step of adding position Information received by 
the receiving step to production Information stored in the 
storage step. 

10 [0298] Accordingly, when the image processing meth- 
od according to the present invention as described is 
applied, partlculariy, to an image pick-up device in a 
broadcasting station, identification infonnation for iden- 
tifying image data and voice data, infonnation relating 

^5 to copyright and so on, and another identification infor- 
mation can be recorded in a recording medium together 
with Image data and voice data. Further, identification 
information is recorded together with image data and 
voice data whereby a burden when a photographer or 

20 an editor carries out photographing and or editing is re- 
lieved and convenience is improved. 
[0299] Furthemnore, a recording medium, according 
to the present invention, having a program recorded, the 
program controlling an image processing apparatus for 

25 administrating image data recorded in a recording me-^ 
dium by another image processing apparatus, thie re- 
cording medium having a program for causing a com- 
puter to execute a process recorded, the process includ- 
ing an input control step of controlling an input of pro- 

30 ductlon information relating to production by another ap- 
paratus, a storage control step of controlling storing pro- 
duction infonnation Input in the input control step corre- 
sponded to another apparatus, a transmission control 
step of controlling transmitting production information 

35 Stored in the storage control step to another apparatus, 
an incorporation control step of controlling Incorporating 
position information at an editing point of image data re- 
corded in a recording medium transmitted from another 
apparatus on the recording medium, and an addition 

^0 control step of controlling addition of position Informa- 
tion incorporated In the incorporation control step to pro- 
duction information stored in the storage control step. 
[0300] Accordingly, when the program recorded in the 
recording medium according to the present invention as 

45 described is applied, particularly, to an image pick-up 
device In a broadcasting station. Identification Informa- 
tion for Identifying image data and voice data, infonna- 
tion relating to copyright and so on, and another identi- 
fication information can be recorded in a recording me- 

50 dium together with image data and voice data. Further, 
identification information is recorded together with im- 
age data and voice data whereby a burden when a pho- 
tographer or an editor carries out photographing and or 
editing is relieved and convenience is Improved. 

55 [0301 ] Furthermore, an Image processing system ac- 
cording to the present Invention comprising afirst Image 
processing apparatus for recording image data in a re- 
cording medium, and a second image processing appa- 
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ratus for administrating image data recorded in the re- 
cording medium by the first image processing appara- 
tus, the first image processing apparatus comprising a 
first input part for inputting image data, a first receiving 
part for receiving production information relating to pro- 
duction transmitted from the second image processing 
apparatus, a recording part for recording production in- 
formation received by the first receiving part and image 
data input by the first input part, a detection part for de- 
tecting a recording position at an editing point of image 
data recorded by the recording part on the recording me- 
dium, and a first transmission part for transmitting infor- 
mation of a recording position detected by the detection 
part to the second image processing apparatus, the sec- 
ond image processing apparatus comprising a second 
input part for inputting production information relating to 
production by the first image processing apparatus, a 
storage part for storing production infomiation input by 
the second input part corresponded to the first Image 
processing apparatus, a second transmission part for 
transmitting production information stored in the storage 
part to the first image processing apparatus, a second 
receiving part for receiving position infomnation at an ed- 
iting point of image data recorded in a recording medium 
transmitted from the first image processing apparatus 
on the recording medium, and an addition part for add- 
ing position information received in the second receiving 
part to production information stored in the storage part. 
[0302] Accordingly, when the Image processing sys- 
tem according to the present invention as described Is 
applied, particularly, to a system for producing a pro- 
gram in a broadcasting station, Identification infomnation 
for identifying image data and voice data, infomnation 
relating to copyright and so on, and another identifica- 
tion information can be recorded in a recording medium 
together with image data and voice data. Further, iden- 
tification infomiation Is recorded together with Image da- 
ta and voice data whereby a burden when a photogra- 
pher or an editor canrles out photographing and or edit- 
ing is relieved and convenience is improved. 
[0303] Furthermore, according to an image process- 
ing method of the present invention, a first Image 
processing method of the first image processing appa- 
ratus Includes a first input step of inputting image data, 
a first receiving step of receiving production infomnation 
relating to production transmitted from the second Im- 
age processing apparatus, a recording step of recording 
production Information received in the first receiving 
step and image data Input in the first input step, a de- 
tection step of detecting a recording position at an edit- 
ing point of image data recorded in the recording step 
on the recording medium, and a first transmission step 
of transmitting information of a recording position de- 
tected in the detection step to the second image 
processing apparatus, and an image processing meth- 
od of the second image processing apparatus includes 
a second input step of Inputting production infomnation 
relating to production by the first Image processing ap- 



paratus, a storage step of storing production information 
input in the second input step corresponded to the first 
image processing apparatus, a second transmission 
step of transmitting production information stored in the 
5 storage step to the first image processing apparatus, a 
second receiving step of receiving position information 
at an editing point of image data recorded In a recording 
medium transmitted from the first image processing ap- 
paratus on the recording medium, and an addition step 
10 for adding position information received in the second 
receiving step to production information stored in the 
storage step. 

[0304] Accordingly, when the image processing meth- 
od according to the present invention as described is 
applied, particularly, to a system for producing a pro- 
gram in a broadcasting station, identification information 
for identifying image data and voice data, Infomnation 
relating to copyright and so on, and another identifica- 
tion Information can be recorded in a recording medium 
together with image data and voice data. Further, iden- 
tification information is recorded together with image da- 
ta and voice data whereby a burden when a photogra- 
pher or an editor carries out photographing and or edit- 
ing is relieved and convenience is improved. 
[0305] Furthermore, the present invention provides a 
recording medium having programs for controlling an 
image processing system recorded, the image process- 
ing system comprising a first image processing appara- 
tus for recording image data in a recording medium, and 
a second image processing apparatus for administrat- 
ing image data recorded in the recording medium by the 
first image processing apparatus, the program for con- 
trolling the first image processing apparatus including a 
first input control step of controlling an input of image 
data, a first incorporation control step of controlling In- 
corporation of production Information relating to produc- 
tion transmitted from the second image processing ap- 
paratus, a record control step of controlling recording of 
production infomnation incorporated in the first incorpo- 
ration control step and image data input In the first input 
control step in the recording medium, a detection control 
step of controlling detection of a recording position of an 
editing point of image data recorded in the record control 
step on the recording medium, and a first transmission 
control step of controlling transmission of information off 
the recording position detected In the detection control 
step, the program for controlling the second image 
processing apparatus having a program for causing a 
computer to execute a process recorded, the process 
Including a second input control step of controlling an 
input of production information relating to production by 
the first image processing apparatus, a storage control 
step of controlling storing production infomnation Input 
in the second input control step corresponded to the first 
Image processing apparatus, a second transmission 
control step of controlling transmission of production in- 
formation stored In the storage control step to the first 
Image processing apparatus, a second incorporation 
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control step of controlling incorporation of position infor- 
mation at an editing point of image data recorded in the 
recording medium transmitted from the first image 
processing apparatus on the recording medium, and an 
addition control step of controlling adding position infor- 5 
mation incorporated in the second incorporation step to 
production information stored in the storage control 
step. 

[0306] Accordingly, when the program recorded in the 
recording medium according to the present invention as io 
described is applied, particularly, to the process in an 
image pick-up device, identification information for iden- 
tifying image data and voice data, information relating 
to copyright and so on, and another identification infor- 
mation can be recorded in a recording medium together i5 
with image data and voice data. Further, identification 
infomnation is recorded together with image data and 
voice data whereby a burden when a photographer or 
an editor carries out photographing and or editing is re- 
lieved and convenience is improved. 20 
[0307] Furthermore, a data transmission device ac- 
cording to the present invention comprises an input par 
for producing and inputting addition information relating 
to news program gathering, and a transmission part for 
transmitting addition information to a mover at a gather- 25 
ing source wireless ly. 

[0308] The addition infomriation are metadata repre- 
sentative of Gathering_Location_Place showing a place 
name of a gathering location, Photographer showing a 
name of a photographer, Journalist Information showing 30 
information relating to a journalist in charge of gathering. 
Director showing a director of a news program. Contents 
having other infomnation relating to production contents 
described. Gathering_Start_DateTime showing produc- 
tion start date time, Gathering_End_DateTime showing 35 
production end time, Producer showing a producer of a 
news program, a news program item registered in NCS 
(Newsroom Computer System) and NCS ID as a iden- 
tifier set every program. 

[0309] Accordingly, in the data transmission device 40 
according to the present invention, when a news pro- 
gram Is produced in a broadcasting station, metadata 
as various addition infomnation such as identification in- 
formation for identifying image data and voice data, in- 
formation relating to copyright and so on, can be trans- ^5 
mined to an image pick-up device together with image 
data and voice data. Further, metadata as addition in- 
fomnation is recorded together with image data and 
voice data whereby a burden when a photographer or 
an editor carries out photographing and or editing is re- so 
iieved and convenience Is improved. 
[0310] Furthermore, a receiving device according to 
the present invention comprises a receiving part for re- 
ceiving addition infomnation relating to a news program 
gathering transmitted from a data transmission device, 
and a storage part for storing the addition information 
received. 

[0311] Accordingly. In the data receiving device ac- 



cording to the present invention, when a news program 
is produced in a broadcasting station, metadata as var- 
ious addition information such as identification informa- 
tion for identifying image data and voice data, informa- 
tion relating to copyright and so on can be received in 
order to record in a recording medium together with im- 
age data and voice data. Further, metadata as addition 
information is recorded together with image data and 
voice data whereby a burden when a photographer or 
an editor carries out photographing and or editing is re- 
lieved and convenience is improved. 
[0312] Furthenrnore, a data transmission and receiv- 
ing system according to the present invention comprises 
a data transmission device having an input part for pro- 
ducing and inputting addition information relating to a 
news program gathering, and a transmission part for 
transmitting addition information wirelessly; and a data 
receiving device having a receiving part for receiving ad- 
dition information relating to news program gathering 
transmitted from the data transmission device, and a 
storage part for starring addition information received. 
[0313] Accordingly, in the data transmission and re- 
ceiving device according to the present invention, when 
a news program is produced in a broadcasting station, 
metadata as various addition information such as iden- 
tification information for Identifying image data and voice 
data, information relating to copyright and so on can be 
received in order to record in a recording medium to- 
gether with image data and voice data. Further, meta- 
data as addition information is recorded together with 
Image data and vobe data whereby a burden when a 
photographer or an editorcarries out photographing and 
or editing is relieved and convenience is improved. 
[0314] Furthermore, an image processing apparatus 
according to the present invention comprises a storage 
part for storing metadata as addition infomnation trans- 
mitted from outside, a metadata producing part for pro- 
ducing metadata separately from the metadata trans- 
mitted from outside, and a recording part for recording 
image data in a recording medium, wherein metadata 
from the metadata storage part and separate metadata 
from the metadata producing part are recorded in the 
recording medium. 

[0315] The separate metadata are metadata repre- 
sentative of Gathering_Location_Latltude representa- 
tive of latitude of a photographing location, 
Gathering_Location_Longititude representative of lon- 
gitude of a photographing location, Gathering_ 
Locatton_Attitude representative of altitude of a photo- 
graphing location, Gathering_Location_Time represent- 
ative of time at the time of photographing, machine ID 
for identifying an image pick-up device, Camera Setup 
Information showing setting of an image pick-up device, 
Reel Number for identifying a recording medium, Dura- 
tion showing time required for photographing, Start Of 
Material representative of start time for each scene. Title 
showing a gathering title, Good Shot Mark showing a 
mark point input manually at the time of photographing 
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and REC Start Mark, Audio Channel Infonnation show- 
ing a microphone channel, Audio Type showing whether 
recording of voice is monophonic, or stereo or bilingual, 
UMID (Audio) which is ID decided solely for identifying 
material, UMID (Video), and Copyright representative of 
copyright of material data. 

[0316] Accordingly, according to the image process- 
ing apparatus of the present invention, a user, in the 
metadata producing part, records addition information 
produced manually or automatically together with image 
data and voice data whereby when a news program is 
produced in a broadcasting station, metadata as various 
addition information such as identification information 
for identifying image data and voice data, information 
relating to copyright and so on can be received together 
with image data and voice data. Further, metadata as 
addition information is recorded together with image da- 
ta and voice data whereby a burden when a photogra- 
pher or an editor carries out photographing and or edit- 
ing is relieved and convenience Is improved. 
[0317] Furthermore, an image processing method ac- 
cording to the present invention comprises metadata 
storage step of storing metadata transmitted from out- 
side, metadata producing step of producing separate 
metadata transmitted from outside, and recording step 
of recording metadata from metadata storage step, sep- 
arate metadata from metadata producing means, and 
image data in the recording medium. 
[0318] Accordingly, according to the image process- 
ing method of the present invention, a user, in the addi- 
tion information producing step, records addition infor- 
mation produced manually or automatically together 
with image data and voice data whereby when a news 
program is produced in a broadcastirig station, metada- 
ta as various addition infonnation such as information 
for identifying image data and voice data, information 
relating to copyright and so on can be received together 
with image data and voice data. Further, metadata as 
addition infonnation is recorded together with image da- 
ta and voice data whereby a burden when a photogra- 
pher or an editor carries out photographing and or edit- 
ing is relieved and convenience is improved. 
[0319] Further, an image processing method of the 
present invention comprises input step of inputting im- 
age data, and metadata representative of 
Gatheiing_Location_Latitude representative of latitude 
of a photographing location relating to position informa- 
tion at the time of photographing image data, 
Gathering_Location_Longitude representative of longi- 
tude, and Gathering_Location_Altitude representative 
of altitude of a photographing location, and retrieving 
step of retrieving and extracting a map corresponding 
to position information out of maps recorded in the re- 
cording device, and combining step of combining a map 
corresponding to position infonnation with a predeter- 
mined position of image data to display it. 
[0320] As described above, metadata representative 
of Gathering_Location_Latitude, Gatherlng_Location_ 



Longitude, and Gathering_Location_Altitude for identi- 
fying image data and voice data as addition information 
are recorded together with image data and voice data, 
and information recorded in a data base using addition 
5 information to be recorded can be extracted and com- 
bined with image data automatically. 
[0321] Accordingly, metadata as addition infonnation 
is recorded together with Image data and voice data 
whereby when materia! is edited, material data and im- 
age data to be combined with the material data can be 
retrieved immediately. Further, other infonnation based 
on addition information input together with image data 
can be retrieved automatically and combined with image 
data to display it. 

[0322] Furthermore, an Image processing method ac- 
cording to the present invention comprises input step of 
inputting image data, and metadata representative of 
Gathering_Location_Time representative of time of 
photographing relating to time information at the lime of 
photographing image data, and combining step of com- 
bining time information corresponding to image data 
with a predetermined position of image data to display it. 
[0323] Accordingly, metadata as addition information 
is recorded together with image data and voice data 
whereby when material is edited, material data and im- 
age data to be combined with material data can be re- 
trieved immediately. Further, other infonnation based on 
addition information input together with image data can 
be retrieved automatically and combined with image da- 
ta to display it. 

[0324] Furthermore, the present invention comprises 
input step of inputting image data, Title showing a gath- 
ering title relating to photographing of image data, and 
metadata representative of Script relating to an article 
original; and combining step of combining metadata with 
a predetemriined position of image data to display it. 
[0325] Accordingly, metadata as addition information 
is recorded together with image data and voice data 
whereby when material is edited, material data and im- 
age data to be combined with material data can be re- 
trieved immediately. Further, other infonnation based on 
addition information input together with image data can 
be retrieved automatically and combined with image da- 
ta to display it. 

[0326] Furthermore, the present invention comprises 
a display part for displaying a combined image of Image 
data and infonnation relating to image data, an input part 
for inputting image data, and metadata representative 
of Gathering_Location_Latitude representative of lati- 
tude of a photographing location relating to position in- 
formation at the time of photographing image data, 
Gathering_Location_Longitude representative of longi- 
tude of a photographing location, Gathering_Location_ 
Altitudes representative of altitude of a photographing 
location. Title showing a gathering title relating to pho- 
tographing of image data, and Script relating to an article 
original; a recording part for recording metadata repre- 
sentative of position information; and a combining part 
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for combining information based on metadata corre- 
sponding to image data with a predetermined positron 
of image data to display it. 

[0327] Accordingly, metadata as addition information 
is recorded together with image data and voice data 
whereby when material is edited, material data and im- 
age data to be combined with material data can be re- 
trieved Immediately. Further, other information based on 
addition information Input together with image data can 
be retrieved automatically and combined with Image da- 
ta to display It. 



Claims 

1 . An image processing apparatus for recording image 
data In a recording medium, comprising: 

input means for inputting image data; 
receiving means for receiving production infor- 
mation relating to production transmitted from 
another apparatus; 

recording means for recording production infor- 
mation received by the receiving means and 
image data input by the input means in the re- 
cording medium; 

detection means for detecting a recording po- 
sition on the recording medium of an editing 
point of image data recorded by the recording 
means; and 

transmission means for transmitting infomia- 
tion of the recording position detected by the 
detection means to another apparatus. 

2- The image processing apparatus according to claim 
1 , wherein said receiving means receives said pro- 
duction Information transmitted wirelessly, and said 
transmission means transmits said information of 
recording position wirelessly. 

3. The image processing apparatus-according to claim 
1, wherein Information of the recording position on 
said recording medium of said editing point is a time 
stamp. 

4. The Image processing apparatus according to claim 
1, wherein said production information includes 
identification information for Identifying said image 
data input by said input means. 

5. The image processing apparatus according to claim 
4, wherein said identification information includes 
at least one out of metadata representative of a 
gathering location place showing a place name of 
a gathering location relating to news program gath- 
ering (Gatherinci_Location_Place). a photographer 
showing a name of a photographer (Photographer), 
journalist Information showing Information relating 
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to a journalist in charge of gathering (Journalist In- 
formation), a director showing a director of a news 
program (Director), contents having other informa- 
tion relating to production contents described (Con- 
tents), gathering start date time showing production 
start date time (Gathering_Start_DateTime), gath- 
ering end date time showing production end time 
(Gathermg_End_DateTime), a producer showing a 
producer of a news program (Producer), a news 
program item registered in an NCS (Newsroom 
Computer System) and NCS ID as an identifier set 
for every program (NCS ID). 

An image processing method for an image process- 
ing apparatus for recording Image data in a record- 
ing medium, comprising: 

input step of inpuning image data; 
receiving step of receiving production informa- 
tion relating to production transmitted from an- 
other apparatus; 

recording step of recording the production in- 
formation received in said receiving step and 
the image data input in said input step in the 
recording medium; 

detection step of detecting a recording position 
on the recording medium of an editing point of 
the image data recorded in said recording step; 
and 

transmission step of transmitting Information of 
the recording position detected in said detec- 
tion step to said another apparatus. 

A recording medium having recorded a program 
which controls an image processing apparatus for 
recording image data in a recording medium, the 
program causing a computer to execute processes 
including; 

input control step of controlling an input of im- 
age data; 

incorporation control step of controlling an In- 
corporation of production infomiatlon relating 
to production transmitted from another appara- 
tus; 

record control step of controlling recording of 
said production Information whose Incorpora- 
tion is controlled in said incorporation control 
step and image data input in said Input control 
step to the recording medium; 
detection control step of controlling detection of 
a recording position of an editing point of the 
Image data recorded in said record control step 
on the recording medium, and 
transmission control step of controlling trans- 
mission of information of the recording position 
detected in said detection control step to anoth- 
er apparatus. 
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8. An image processing apparatus for administrating 
image data recorded in a recording medium by an- 
other image processing apparatus, comprising: 

input means for inputting production informa- s 
tion relating to production by said another ap- 
paratus; 

storage means for storing said production infor- 
mation input by said input means corresponded 
to said another apparatus; io 
transmission means for transmitting said pro- 
duction infomnation stored in said storage 
means to said another apparatus; 
receiving means for receiving said position in- 
fomnation on the recording medium of an edit- ^5 
ing point of image data recorded in the record- 
ing medium; and 

adding means for adding said position informa- 
tion received by said receiving means to said 
production information stored in said storage 
means. 

9. The image processing apparatus according to claim 
8, wherein said receiving means receives said po- 
sition information transmitted wirelessly by said an- 25 
other apparatus. 

10. The image processing apparatus according to claim 
8, wherein infomnation of a recording position on 
said recording medium of said editing point is a time 30 
stamp. 

1 1 . The image processing apparatus according to claim 
8, wherein production information includes identifi- 
cation information for identifying said image data in- 35 
put by said input means. 

12. The image processing apparatus according to claim 
11, wherein said identification information includes 

at least one out of metadata representative of a 40 
gathering location place showing a place name of 
a gathering location relating to news program gath- 
^. ering (Gathering_Location_Place), a photographer 
showing a name of a photographer (Photographer), 
joumallst information showing information relating 45 
to a journalist in charge of gathering (Journalist In- 
formation), a director showing a director of a news 
program (Director), contents having other informa- 
tion relating to production contents described (Con- 
tents), gatheririg start date time showing production so 
start date time (Gathering_Start_DateTime), gath- 
ering end date time showing production end time 
(Gathering_End_DateTlme), a producer showing a 
producer of a news program (Producer), a news 
program item registered in an NCS (Newsroom 55 
Computer System) and NCS ID as an Identifier set 
for every program (NCS ID). 



13. An image processing method of an image process- 
ing apparatus for administrating image data record- 
ed in a recording medium by another image 
processing apparatus, comprising: 

input step of inputting production information 
relating to production by said another appara- 
tus; 

storage step of storing production information 
input by said input step corresponded to said 
another apparatus; 

transmission step of transmitting production in- 
formation stored in said storage step to said an- 
other apparatus; 

receiving step of receiving position information 
on the recording medium of an editing point of 
image data transmitted from said another ap- 
paratus and recorded in said recording medi- 
um; and 

adding step of adding said position information 
received by said receiving step to said produc- 
tion Information stored In said storage step. 

14. A recording medium having recorded a program 
which controls an image processing apparatus for 
administrating image data recorded in a recording 
medium by another image processing apparatus, 
said program causing a computer to execute a proc- 
ess including: 

input control step of controlling an input of pro- 
duction information relating to production by 
said another apparatus; 
storage control step of controlling storing said 
production infonnation Input in said Input con- 
trol step corresponded to said another appara- 
tus; 

transmission control step of controlling trans- 
mitting said production infomnation stored in 
said storage control step to said another appa- 
ratus; 

incorporation control step of controlling incor- 
porating position infonnation on the recording 
medium at an editing point of image data re- 
corded in said recording medium transmitted 
from said another apparatus; and 
addition control step of controlling addition of 
said position information incorporated in said 
incorporation control step to said production in- 
formation stored In said storage control step. 

15. An image processing system comprising a first im- 
age processing apparatus for recording image data 
in a recording medium, and a second image 
processing apparatus for administrating image data 
recorded in the recording medium by said first im- 
age processing apparatus, 
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said first image processing apparatus compris- 
ing; 

first input means for inputting image data; 
first receiving means for receiving production 
information relating to production transmitted 5 
from said second image processing apparatus; 
recording means for recording the production 
information received by said first receiving 
means and the image data input by said first 
input means; io 
detection means for detecting a recording po- 
sition on said recording medium at an editing 
point of said image data recorded by said re- 
cording means; and 

first transmission means for transmitting infer- ts 
mation of said recording position detected by 
said detection means to said second image 
processing apparatus, 

said second image processing apparatus com- 
prising: 20 

second input means for inputting produc- 
tion Infomnation relating to production by 
said first image processing apparatus; 
storage means for storing said production 25 
information input by said second input part 
corresponded to said first image process- 
ing apparatus; 

second transmission means for transmit- 
ting said production information stored in 30 
said storage means to said first image 
processing apparatus; 
second receiving means for receiving po- 
sition information on a recording medium 
at an editing point of image data recorded 35 
in said recording medium transmitted from 
said first image processing apparatus; and 
addition means for adding said position in- 
fomriation received in said second receiv- 
ing means to said production information 40 
stored in* the storage means. 



16. The image processing system according to claim 
15, wherein said first receiving means receives said 
production infonmation transmitted wirelessly, and 45 
said first transmission means transmits information 

of said recording position wirelessly. 

17. The image processing system according to claim 

15, wherein said second receiving means receives so 
said position information transmitted wirelessly by 
said first image processing apparatus. 

18- The image processing system according to claim 

15, wherein information of a recording position on 55 
said recording medium at said editing point Is a time 
stamp. 



19. An image processing method of an image process- 
ing system comprising a first image processing ap- 
paratus for recording image data in a recording me- 
dium and a second Image processing apparatus for 
administrating Image data recorded in a recording 
medium by said first image processing apparatus, 

image processing method of said first image 
processing apparatus Including: 

first input step of inputting image data; 
first receiving step of receiving production 
information relating to production transmit- 
ted from said second Image processing ap- 
paratus; 

recording step of recording said production 
Infomnation received in said first receiving 
step and image data input in said first input 
step; 

detection step of detecting a recording po- 
sition on said recording medium at an ed- 
iting point of said image data recorded in 
said recording step; and 
first transmission step of transmitting infor- 
mation of said recording position detected 
in said detection step to said second image 
processing apparatus, and 
image processing method of said second 
image processing apparatus including: 

second input step of inputting produc- 
tion infomnation relating to production 
by said first Image processing appara- 
tus; 

storage step of storing said production 
information Input In said second input 
step corresponded to said first image 
processing apparatus; 
second transmission step of transmit- 
ting said production Information stored 
in said storage step to said first image 
processing apparatus; 
second receiving step of receiving po- 
sition information on a recording medi- 
um at an editing point of Image data 
recorded in said recording medium 
transmitted from said first image 
processing apparatus; and 
addition step of adding said position in- 
formation received in said second re- 
ceiving step to said production infor- 
mation stored in said storage step. 

20. A recording medium having recorded programs for 
controlling an image processing system which com- 
prises a first image processing apparatus for re- 
cording Image data in a recording medium, and a 
second Image processing apparatus for adminis- 
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trating Image data recorded in the recording medi- 
unn by said first image processing apparatus, the 
program causing a computer to execute processes, 
wherein 

5 

the program for controlling said first image 
processing apparatus includes: 

first input control step of controlling an input 
of image data; io 
first incorporation control step of controlling 
Incorporation of production information re- 
lating to production transmitted from said 
second image processing apparatus; 
record control step of controlling recording is 
of production information incorporated in 
said first Incorporation control step and im- 
age data input in said first input control step 
in said recording medium; 
detection control step of controlling detec- 20 
tion of a recording position on said record- 
ing rpedium at an editing point of said im- 
age data recorded in said record control 
step; and 

first transmission control step of controlling 25 
transmission of information of said record- 
ing position detected in said detection con- 
trol step, and wherein 
the program for controlling said second im- 
age processing apparatus includes: so 

second input control step of controlling 
an input of production information re- 
lating to production by said first image 
processing apparatus; 35 
storage control step of controlling stor- 
ing production information input in said 
second input control step correspond- 
ed to said first image processing appa- 
ratus; 40 
second transmission control step of 
controlling transmission of production 
information stored in said storage con- 
trol step to said first image processing 
apparatus; 4S 
second incorporation control step of 
controlling incorporation of position in- 
formation at an editing point of image 
data recorded in said recording medi- 
um transmitted from said first image so 
processing apparatus on the recording 
medium; and 

addition control step of controlling add- 
ing position information incorporated 
in said second incorporation step to ss 
production information stored in the 
said storage control step. 



21. A data transmission apparatus comprising: 

input means for producing and inputting at least 
one out of metadata representative of a gath- 
ering location place showing a place name of a 
gathering location relating to news program 
gathering (Gathering_Locatron_Place), a pho- 
tographer showing a name of a photographer 
(Photographer), journalist Information showing 
infonnatlon relating to a journalist in charge of 
gathering (Journalist Information), a director 
showing a director of a news program (Direc- 
tor), contents having other information relating 
to production contents described (Contents), 
gathering start date time showing production 
start date time (Gathering_Start_DateTime), 
gathering end date time showing production 
end lime (Gathering_End_DateTime), a pro- 
ducer showing a producer of a news program 
(Producer), a news program item registered in 
an NCS (Newsroom Computer System) and 
N OS ID as an Identifier set for every program 
(NCS ID); and 

transmission means for transmitting said meta- 
data wirelessly to a mover of a gathering 
source. 

22. The data transmission apparatus according to claim 
22, wherein said mover transmits said data wire- 
lessly to an image pick-up device for carrying out 
gathering. 

23. A data receiving apparatus comprising: 

receiving means for receiving at least one out 
of metadata representative of a gathering loca- 
tion place showing a place name of a gathering 
location relating to news program gathering 
(Gathering_Location_Place), a photographer 
showing a name of a photographer (Photogra- 
pher), journalist Infonnatlon showing Infomria- 
tion relating to a journalist in charge of gather- 
ing (Joumalist Information), a director showing 
a director of a news program (Director), con- 
tents having other Information relating to pro- 
duction contents described (Contents), gather- 
ing start date time showing production start 
date time (Gathering_Start_DateTime), gather- 
ing end date time showing production end time 
(Gathering^End.DateUme), a producer show- 
ing a producer of a news program (Producer), 
a news program Item registered in an NCS 
(Newsroom Computer System) and NCS ID as 
an identifier set for every program (NCS ID) 
transmitted from a data transmission appara- 
tus; and 

storage means for storing said metadata re- 
ceived. 
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24. The receiving apparatus according to claim 23, 
wherein said data receiving apparatus is a portable 
type moving terminal. 

25. The data receiving apparatus according to claim 24, 
wherein said portable type moving terminal is con- 
nected to an image pick-up device for carrying out 
gathering. 

26. The data receiving apparatus according to claim 25, 
wherein said portable type moving terminal and 
said image pick-up device are connected by wire- 
less communication. 

27. A data transmission and receiving system compris- 
ing: 

a data receiving device having input means for 
producing and inputting at least one out of 
metadata representative of a gathering location 
place showing a place name of a gathering lo- 
cation relating to news program gathering 
(Gathering_Location_Place), a photographer 
showing a name of a photographer (Photogra- 
pher), journalist information showing informa- 
tion relating to a journalist in charge of gather- 
ing (Journalist Information), a director showing 
a director of a news program (Director), con- 
tents having other infomriation relating to pro- 
duction contents described (Contents), gather- 
ing start date time showing production start 
date time (Gathering_Start_DateTime), gather- 
ing end date time showing production end time 
(Gathering_End_DateTime), a producer show- 
ing a producer of a news program (Producer), 
a news program item registered In an NCS 
(Newsroom Computer System) and NCS ID as 
an identifier set for every program (NCS ID), 
and transmission means for transmitting meta- 
data wirelessly; and 

a data receiving device comprising receiving 
means for receiving said metadata relating to 
news program gathering transmitted from said 
data transmission device, and storage means 
for storing said metadata received. 

28. The data transmission and receiving system ac- 
cording to claim 27, wherein said data receiving de- 
vice is a portable type moving temiinal. 

29. The data transmission and receiving system ac- 
cording to claim 28, wherein said portable type mov- 
ing tenninal is connected to an Image pick-up de- 
vice for carrying out gathering. 

30. The data transmission and receiving system ac- 
cording to claim 29, wherein said portable type mov- 
ing terminal and said Image pick-up device are con- 
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nected by wireless communication. 

31. An image processing apparatus comprising: 

metadata storage means for storing metadata 
transmitted from outside; 
metadata producing means for producing at 
least one out of metadata representative of a 
gathering location latitude representative of lat- 
itude of a photographing place (Gathering^ 
Locatlon_Latitude), a gathering location longi- 
tude representative of a longitude of a photo- 
graphing place (Gathering_Location_Longi- 
tude), a gathering location altitude representa- 
tive of altitude of a photographing place 
(Gathering_Location_Altitude). a gathering lo- 
cation time representative of time when photo- 
graphing takes place (Gathering„Location_ 
Time), machine ID for identifying a photograph- 
ing device, camera setup Information showing 
setting of a photographing device (Camera Set- 
up Information), a reel number for identifying a 
recording medium (Reel Number), duration 
showing time required for photographing (Du- 
ration), start of material representative of start 
time of each scene (Start Of Material), a title 
representative of gathering title (Title), a good 
shot mark showing a mark point manually input 
when photographing take place (Good Shot 
Mark), record start mark (REC Start Mark), au- 
dio channel information showing a microphone 
channel (Audio Channel Infomriation), an audio 
type showing if a voice record is mono, stereo 
or bilingual (Audio Type), UMID audio which is 
ID decided solely for identifying material (UMID 
(Audio)), UMID video (UMID (video)), copyright 
representative of copyright of material data 
(Copyright); and 

recording means for recording image data in a 
recording medium, wherein 
metadata stored in said metadata storage 
means and metadata produced in said metada- 
ta producing means are recorded in said re- 
cording medium together with image data. 

32. The Image processing apparatus according to claim 
31 ; wherein said metadata transmitted from outside 
are metadata representative of a gathering location 
place showing a place name of a gathering location 
relating to news program gathering (Gathering^ 
Location_Place), a photographer showing a name 
of a photographer (Photographer), journalist infor- 
mation showing information relating to a journalist 
in charge of gathering (Journalist Infomriation), a di- 
rector showing a director of a news program (Direc- 
tor), contents having other information relating to 
production contents described (Contents), gather- 
ing start date time showing production start date 
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time (Gathering^Start_DateTlme), gathering end 
date time showing production end time (Gathering. 
End_DateTime), a producer showing a producer of 
a news program (Producer), a news program item 
registered in an NCS (Newsroom Computer Sys- 
tem) and NCS ID as an identifier set for every pro- 
gram (NCS ID). 

33. The image processing apparatus according to claim 
31 , wherein said meta data producing means is op- 
erating means for inputting metadata by operation 
of a user. 

34. The image processing apparatus according to claim 
31, wherein said meta data producing means is a 
global positioning system, which automatically pro- 
duces metadata based on position information de- 
tected in said global positioning system. 

35. An Image processing method comprising: 

metadata storage step of storing metadata 
transmitted from outside; 
metadata producing step of producing at least 
one out of metadata representative of a gath- 
ering location latitude representative of latitude 
of a photographing place (Gathering^, 
Location_Latitude), a gathering location longi- 
tude representative of a longitude of a photo- 
graphing place (Gathering_Locatlon_Longl- 
tude), a gathering location altitude representa- 
tive of altitude of a photographing place 
(Gathering_Locat}on_Altitude), a gathering lo- 
cation time representative of time when photo- 
graphing takes place (Gathering_Locatlon_ 
Time), machine ID for identifying a photograph- 
ing device, camera setup inforriiatlon showing 
setting of a photographing device (Camera Set- 
up Information), a reel number for Identifying a 
recording medium (Reel Number), duration 
showing time required for photographing (Du- 
ration), start of nlaterial representative of start 
- time of each scene (Start Of Material), a title 
representative of gathering title (Title), a good 
shot mark showing a mark point manually input 
when photographing take place (Good Shot 
Mark), record start mark (REC Start Mark), au- 
dio channel information showing a microphone 
channel (Audio Channel Information), an audio 
type showing if a voice record is mono, stereo 
or bilingual (Audio Type), UMID audio which is 
ID decided solely for identifying material (UMID 
(Audio)), UMID video (UMID (video)), copyright 
representative of copyright of material data 
(Copyright); and 

recording step of recording metadata stored in 
said metadata storage step, metadata pro- 
duced in said metadata producing step, and im- 
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age data in said recording medium. 

36. The image processing method according to claim 
35, wherein said metadata transmitted from outside 
are metadata representative of a gathering location 
place showing a place name of a gathering location 
relating to news program gathering (Gathering_ 
Location_Place), a photographer showing a name 
of a photographer (Photographer), journalist infor- 
mation showing Infomnation relating to a journalist 
in charge of gathering (Journalist Infomnation), a di- 
rector showing a director of a news program (Direc- 
tor), contents having other information relating to 
production contents described (Contents), gather- 
ing start date time showing production start date 
time (Gathering_Start_DateTime), gathering end 
date time showing production end time (Gathering. 
End_DateTime), a producer showing a producer of 
a news program (Producer), a news program item 
registered in an NCS (Newsroom Computer Sys- 
tem) and NCS ID as an Identifier set for every pro- 
gram (NCS ID). 

37. The image processing method according to claim 
35, wherein in said metadata producing step, meta- 
data are input by a user. 



38. The image processing method according to claim 
35, wherein in said metadata producing step, meta- 
30 data based on position infomnation detected in said 
global positioning system are automatically 
produced . 



39. An image processing method comprising: 

input step of inputting image data and metadata 
representative of a gathering location latitude 
representative of latitude of a photographing 
V place relating to position information at the time 

of photographing said image data (Gathering. 
Location_Latitude), a gathering location longi- 
tude representative of longitude of a photo- 
graphing place (Gathering_Location_Longi- 
tude), and a gathering location altitude repre- 
sentative of altitude of a photographing place 
(Gathering_Location_Altitude); 
retrieving sep for retrieving and extracting a 
map corresponding to said position information 
out of maps recorded in a recording device; and 
combining step of combining and displaying a 
map corresponding to said position infomnation 
with a predetermined position of said image da- 
ta. 



55 40. The Image processing method according to claim 
39, wherein said combining step has a selection 
step of selecting a desired display position from a 
plurality of templates by a user. 
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41. An image processing method comprising: 

input step of inputting image data and nnetadata 
representative of gathering location time repre- 
sentative of time at the time of photographing 5 
relating to time infonnation at the time of pho- 
tographing said image data (Gathering^ 
Location_Time); and 

combining step of combining and displaying 
time information corresponding to said image io 
data with a predetermined position of said im- 
age data. 

42. The image processing method according to claim 

41 , wherein said combining step has a selection is 
step of selecting a desired display position from a 
plurality of templates by a user. 

43. An image processing method comprising: 

20 

input step of inputting image data, and metada- 
ta representative of a title showing a gathering 
title relating to photographing of said image da- 
ta (Title) and of a script relating to an article orig- 
inal (Script); and 25 
combining step of combining said metadata 
with a predetemiined position of said image da- 
ta to display it. 
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based on said metadata corresponding to said 
Image data with a predetermined position of 
said Image data. 

46. The image processing apparatus accordingto claim 
45, wherein said display part displays a graphical 
user interface for selecting a display position of in- 
formation relating to image data corresponding to 
said image data together with said combined im- 
age. 

47. The image processing apparatus according to claim 
46 wherein image data for starting combination of 
information relating to said image data and image 
data for ending combination of information relating 
to said image data are displayed on said graphical 
user interface. 

48. The image processing apparatus according to claim 
46 wherein said graphical user interface includes 
selection means for selecting a desired display po- 
sition from templates displaying a pattern of the dis- 
play position of information relating to said image 
data. 



44. The image processing method according to claim 30 
43, wherein said combining step has a selection 
step of selecting a desired display position from a 
plurality of templates by a user. 

45. An image processing apparatus comprising: 35 

display part for displaying a combined Image of 
image data and infomriation relating to image 

data; 

input means for inputting a display part for dis- 40 
playing a combined image of image data and 
information relating to Image data, and meta- 
data representative of a gathering location lat- 
itude representative of latitude of a photograph- 
ing place relating to image data and position in- 45 
formation at the time of photographing said im- 
age data {Gatherlng_Locatlon_Latilude). a 
gathering location longitude representative of 
longitude of a photograpning place 
(Gathering_Locatiori^Longitude), a gathering so 
location altitude representative of altitude 
(Gathering_Locatlon_Altitude), a title showing 
a gathering title relating to photographing of 
said image data (Title), and a script relating to 
an article original (Script); 55 
recording means for recording said metadata 
showing position Information; and 
combining means for combining information 
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